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ABSTRACT 


A deterministic analysis of the limit cycle oscillations 
which occur in fixed-point implementations of recursive 
digital fiiters due to roundoff and truncation quantization 
after multiplication operations, is performed. Amplitude 
bounds, based upon a correlated nonstochastic signal approach 
and Lyapunov's direct method, as well as an approximate 
expression for the frequency of zero-input limit cycles, 
are derived and tested for the two-vole filter. The limit 
cycles are represented on a successive value phase-plane 
diagram from which certain symmetry properties are derived. 
Similar results are developed for other second-order digital 
filter configurations, and the parallel and cascade forms. 
MiemeecouttS are extended to include limit cyocJes under in- 
put signal conditions. A basic design relationship between 
the number of Significant digits required for the realization 
of a filter algorithm with a desired signal-to-noise (limit 


cycle) ratio is stated. 
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SNE RODVeET ION 


A. INTRODUCTORY REMARKS 

When a digital filter is implemented on a jenewalom 
Special purpose computer, errors due to finite precision in 
the representation of numbers are unavoidable. The finite 
arithmetic in the computer generates roundoff or truncation 
errors which are due to the quantization nonlinearities in- 
troduced when implementing a digital filter algorithm. They 
give rise to nonlinear effects such as limit cycle oscilla- 
tions as well as approximations in a filter realization. 
This dissertation is mainly concerned with the type of error 
which has been called by various names in the literature, 
sucn as “deadband effect" [24], VOUS ae © a eee ome inns 
eyvelte oscillations" [26], or "low-level correlated nolse 

the analysis of quantization noise on a statistical basis 
has been discussed by many authors. ‘This approach is approx:.- 
mate and is based on the assumption that CWE Zc Metso 
occur in a random manner. In this dilssertatien ene genera- 
Seion of spurious Signals generated by quantization is analy- 
zed from a correlated, deterministic PONG Of eviewoeineam effort 
to determine: 1) bounds on the limit cycle amplitude, 2) ex- 
pressions for the limit cycle frequency, and 3) existence 
Senaitions. 

A digital filter is defined as a time-invariant, discrete 
Or sampled-data system with finite accuracy in the represen- 


tation of all data and parameter values. More EOrma 1s werd is: 





time-invariant linear operation on discrete time signals may 
be classified as a digital filter [1]. Such an operation is 
defined by the process by which a Giscrete time output sig- 
nal is determined from a discrete time input signal. 

A digital filter can be viewed as a computer which is 
programmed to operate on the incoming sequence of numbers in 
a specified way so as to generate the desired output sequence 
of numbers. A schematic representetion of a low-pass digi- 
tal filter is depicted in Fig. 1.1. The input x5 (nT) to the 
filter is a sequence of numbers, equally spaced in time and 
separated by the sampling time T. If a continuous signal 
x, (t) is the input, then an analog to digital (A/D) conver- 
sion has to be performed first to cenerate the required 
sequence of numhers, Similarly; if a continuous sianal is 
needed as the output, a eae eal to analog conversion (D/A), 
by using, for example, a zero-order hold, has to take place. 
Sampling and processing of data in discrete time 1S analogous 
to a filtering operation in continuous time. The synthesis 
or the development of the discrete time algorithm to meet a 
Filtering specification is amply discussed in the literature 
and is not considered in this dissertation [4,5,30]. 

Initially, digital filters were applied to the simula- 
tion of analog systems or off-line signal processing of 
such signals as seismic data. In recent years, digital fil- 
ters have been used mcre and more for real time signal pro- 


Sessing. By real time, itis implied that digital processing 








takes place fast enough so that the output of the dic_tal 
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ayatlaclemror directecontrolper observakion in 
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a larger system. Digital filteus ane constructed suc mnamcasc 
tal logic components as their basic building blocks and the 
rapid advance in the development of solid-state devices has 
made such digital filters practical. The development of 
large scale circuit integration (LSI) promises to make these 
systems even more economical. 

The advantages of digital filters over their analog 
counterparts are numerous [1]. Some of the advantages are 


a) arbitrary high precision in the computational process, 
b) no parameter or component value drifting, 


eo. Levswoeelityein the processing procedure, whick-—alloyws 
the construction of adaptive filters, 


a no necessity for impedance matching, 

e) possibility to use time-sharing techniques, 
ie ecasy realization of complex circuits, 

Gee high reliability, 

ioe Small Circuit size, 


1) decreasing costs for mass-produced basic building 
blocks. 


One of the inherent limitations of digital filters is 
related to the fact that all numbers representing either cata 
or filter coefficients are expressed with a finite number of 
omic icant digits. 

In order to realize digital filters, two distinct problems 
have to be solved. The first represents the approximation 
problem, i.e., the filter design required to realize a ratio- 
nal transfer Penerion- OF finite order which approximates in 
some sense either a desired frequency response characteristic 
or a desired time domain response. This approximation pro- 
blem is not considered here and it is assumed that a 
desired rational transfer function already exists. 
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The second problem is concerned with the implementation 
or synthesis of the filter, i.e., thevrieen algentemneand 
a filter configuration which efficiently implement the 
transfer function. Jackson [2] has discussed these two 
phases and their interdependence in detail. In this dis- 
sertation those special aspects of the implementation phase, 
pertaining to the generation of limit cycle oscillations 
are investigated in detail. 

Four factors have to be considered when implementing a 
filter. These are: 

a) choice,of a numerical algorithm, 


b) selection of a specific configuration for the 
filter, 


0 
Q 
= 
0 
— 
Q 
® 


rf the arithmetic mode, i.e., the number sys- 
r=) 


used, 

ad) specification of the number of significant digits. 

Since limit cycle oscillations occur mainly in fixed- 

point implementations of recursive digital filters, the 
Other possible computational algorithms, such as non- 
recursive digital filters and Fast Fourier Transform (FFT) 
filters are not considered. A recursive digital filter is 
defined as a filter in which the present output depends on 
the present input and past inputs and outputs, while for a 
nonrecursive filter the output depends on past and present 
inputs only. It should be noted, that most digital filters 


are of the fixed-point variety because floating-point 
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arithmetic involves more hardware. Also, most filters are 
recursive because for the same degree of approximation, re- 
cursive filters are generally simpler than nonrecursive 
forms. A discussion of fixed-point versus floating-point 
arithmetic, together with considerations of the number of 
Significant digits required for a given precision and signal- 
to-noise ratio, appears in the next section. 

For a given filter transfer function many equivalent 
Configurations, i.e., different arrangements of the arithme- 
tic functions or elements of the filter (such as delays, 
adders and multipliers) can be devised. Kaiser [3] has shown 
miata Cascade or parallel form composed of first and second— 
order subfilters is preferable over any direct realization 
Seer higher order digital filter. Thus, a higher order fil- 
fenis Obtained by combining second-order sections. For 
tNis reason, second-order filter configurations with the re- 
[eretlOon Of finite precision in the arithmetic are studied. 
It should be noted that several different configurations can 
be derived for the same transfer function. Despite the 
fact that the configurations have an identical transfer func- 
Mreom, their generation of limit cycles and noise due to 
quantization may be different. 

This section is now concluded with a review of those 
references from the literature which describe several gen- 
eral aspects of digital filtering. Kaiser [4] has reviewed 
mee iustory Of digital filters and presents an extensive 


eee 


bibliography which references work published before 1266. 
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He discusses various filter design techniques, including non-— 
recursive filters and the application of the Fast Fourier 
Transform. A book by Gold and Rader [5] presents a thorough 
introduction into digital signal processing. The book starts 
with a development of the basic theory for analysis of lin- 
ear digital filters, introduces design techniques for digi- 
tal filters employing the frequency domain and presents some 
basic concepts of quantization errors. The FFT algorithm is 
explained and in a separate chapter, written by Stockham, 

the application of the FFT to implement convolution is de- 
scribed. Oppenheim [6] has edited a collection of 20 impor- 
femme research papers which cover the topics of z-transform 
mieory, digital filter design, nonrecursive digital filters, 


er ~ lene 7 — ats | -—-- -) = we we we ee = eal en rea ac een plan 
tne appiication of the FFT and hardware design ror 


and 
tal filters and FFT implementations. These papers are selec- 
ted to complement the book by Gold and Rader mentioned above. 
A comprehensive bibliography of 142 papers and 41 books pub- 
fished before 1970 is included. Some important current re- 

search about digital filters is also published.in two special 


issues of the IEEE Transactions on Audio and Electroacoustics 


[7,8]. 


pee OOURCES OF ERRORS IN DIGITAL FILTERS 

In practical digital filters finite number representation 
of coefficients and data is required. Theoretically, accura- 
cy could be maintained arbitrarily high; puree inseNe pEeOcess 
of implementing a particular filter structure a tradeoff 


between accuracy, signal-to-noise ratio and overall system 


12 





cost has to be performed. Three sources of error have to 
be considered. They are 


a) analog to digital (A/D) conversion errors, 


b) errors because of finite representation of the digital 
filter coefficients, 


¢c) quantization errors, due to rounding off or truncat-— 
ing the result of multiplication of data with filter 
coefficients. 

Eire first “seurce Of Error, A/D conversmten, 1S Studied 
extensively by Bennett [9]. Its effect is normally taken 
into account by placing a noise source at the input of the 
Filter. This noise represents the error generated by the 
Quantization process on the input signal. In this disserta- 
tion it is assumed that the sampled data already exists in 
merorm SUitable for processing in a digital filter, il.e., 
as GO eis cree (SG 
iecant digits. 

The second source of error, finite representation of 
filter coefficients, is a deterministic effect. It can be 
taken into account by recomputing the eigenvalues of the 
filter with the truncated coefficients. The small changes 
in the filter coefficients due to finite number representa- 
tion results in a corresponding change in the eigenvalues. 
causer [3] has studied the sensitivity of the eigenvalues or 
Pere positionsof an aes Order teniqutta ly fil temduemro mcOct= 
ficient quantization. In this approximate analysis, he 
Concludes that for a direct filter realization, the sensi- 


tivity of the pole positions increases with the order n of 


the equation. This result has been corroborated in work 


iS 





reported by Knowles and Olcayto [10]. 
toi Ueneces Dap e # several nou Mee ee 

cal results from the simulation of practical filters are 
stated and compared. Rader and Gold [12] have studied the 
coefficient quantization problem for second-order digital 
filters. They conclude that a realization via a pair of 
coupled first-order sections is less sensitive to coeffi- 
cient changes than a single second-order form. Mantey [13] 
has studied the coefficient guantization problem by select- 
ing a state variable representation for the digital filter. 
His results, as well as the results from the other workers 
mentioned before, indicate that a digital filter should be 
realized by a parallel or cascade connection of first or 
second order subfilters instead of a direct n*. order 
realization. 

ier third source of error occurs with quantization c= ten 
arithmetic operations. The two most often employed guanti- 
zation procedures are roundoff to the nearest integer and 
Miunecation. They are described in more detail-.in Chapter Til. 
The effects of quantization after arithmetic operations can 
be demonstrated with the example of a first-order digital 


filter described by the following difference equation’: 


w 


x(n) = -a Or a) + u (ie Civ, 18) 


: a 
~*In this dissertation the simpler notation x(n} instead 
of x(nT). will be employed. Some authors also use x Ors 
(nT). Furthermore, the circumflex is used to designate the 
mBesults of finite precision arithmetic, 1.e€., quantized 
MUMDer Ss . 
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Suppose that all numbers oe a, u(n) are expressed initially 
with k significant digits and that fixed-point arithmetic is 
employed for the implementation of the difference equation 
(1.1). Calculation of the filter response shows that after 

n iterations oy 1s expressed by numbers with (n+1l)k signi- 
ficant digits. The foregoing esrenere indicates that the 
number of significant digits, needed to compute the filter 
response precisely, increases linearly with each iteration. 
ay practical filter, realized with k significant digits, 
has to include quantization after each arithmetic operation 
to keep the results at a specified finite precision. 

Mahe choice of the arithmetic mode influences the quanti- 
zation noise. Most noise analyses have been carried out for 
fixed-point arithmetic, because this arithmetic mode is 
easier to realize than the other modes. If fixed-point arith- 
metic is employed, the number of significant digits deter- 
mines the dynamic range of the filter. Since the signal 
levels in the filter may change drastically from one sub- 
section to the next, scale factors are included at each sec- 
tion to allow use of the full dynamic range available. On 
the other hand, floating-point arithmetic is more complex, but 
provides a means of automatic scaling. Since all numbers are 
represented by a mantissa and an exponent, the exponents re- 
present the scale factors. Block floating-point arithmetic 
is an intermediate mode, where a single exponent is specified 
for an entire block of numbers. Weinstein and Oppenheim [14] 


have performed a comparison of the signal-to-noise ra‘ios 


ao 








por filters with fixed-point, block floating oot mane 
floating-point arithmetic. It is shown there that the float- 
ing-point arithmetic mode is generally less noisy than the 
fixed-point mode. As expected, the block floating-point 
arithmetic mode lies between the other two types as far as 
quantization noise is concerned. 

The analysis of the quantization noise has been attempted 
from two different points of view. The first results ina 
stochastic approach. It is based on the necessary assumption 
that the quantization noise sequences from different multi- 
pliers in the filter are statisticaily independent and un- 
correlated with each other and with the processed signal. 

The quantization noise is described by a uniform probability 
Gensity function. ‘ne assumption leads to accentably accurate 
results for most applications with high signal level and 
sufficient spectral content. Although the simple noise model 
presented above has been applied successfully in many cases, 
there exist counterexamples for which the assumptions do not 
hold. Among these are the limit cycle oscillations which 

are studied in the next chapters. Ultimately, one must re- 
sort to experiment to verify the predictions based on the 
statistical model. Jackson [2,15,16]) has performed a com- 
prehensive study of roundoff noise in digital filters for 

the fixed-point arithmetic mode using the stochastic approach. 
His results show excellent agreement between theory and ex- 
periment. Using the same stochastic approach Kaneko and 


Liu {17] have analyzed the quantization noise properties of 
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floating-point digital filters and Weinstein [18] has re- 
ported on the noise properties of block floating-point digi- 
Gabe filters. 

By contrast, the other approach to the analysis of quan- 
tization noise is a deterministic one. Bertram [19] and 
Similarly Slaughter [20] have derived an upper bound on the 
quantization error in sampled-data control systems which is 
independent. of the forcing function. Johnson [21] and Lack 
[22] apply Lyapunov's direct method to derive an upper 
bewund on the guantization error in sampled-data control 
systems which is shown to be tighter than the bound reported 
Mmapeertram. The results from Johnson and Lack have been” re- 
pommulated in Appendix A of this disssertation to apply to 
fixed-point digital filters. Sandberg [23} has presented 
Meanalysis of quantization errors cue to roundoff in 
floating-pcint recursive filters. YThe difficulty with the 
deterministic bounds is that they apply to the situation 
where all errors add up in the worst. possible way. Thus, 
the deterministic bounds are in general overly .pessimistic 
compared with the bounds from the stochastic approach and 
with experimental results. 

However, in situations where the assumptions of the 
stochastic approach fail to apply, the deterministic approach 
is the only method of attack which leads to useful results, 
This is the case when limit cycles occur which, by their 
Mery nature, are generated by quantization error sequences 
which are highly correlated. The existence of low-le el or 


zero-input correlated noise was first reported by Blackman 


ty, 





[24], who called it the “deadband effect". Betten [25] 
analyzed the limit cycles using the describing function tech- 
nique for higher order sampled-data systems and the phase- 
plane technique for second-order unity feedback control 
systems with one roundoff quantizer in the forward path of the 
feedback system. Similarly, results reported by White [26] 
are derived from the work of Betten. However, these results 
cannot be generalized to digital filters where several quan- 
tizer nonlinearities in the feedback structure complicate 
the analysis. Jackson [27] linearized the quantized digital 
filter and derived bounds on the amplitude of zero-input 
limit cycles which are close to the value which are obtained 
by experiment. Since his model is not exact, there exist 
important nontrivial excevtions to the derived bounds. 
Bonzanigo [28] derived bounds for the amplitude of some sim- 
ple limit cycles which are essentially the same as those 
derived by Jackson. Pfundt and Todtli [29] recognized the 
existence of limit cycles for the special case of a digital 
oscillator realized with finite precision arithmetic. How- 
ever, their major contribution consists of one hardware 
realization of such oscillators. They do not discuss the 


theory of limit cycle generation. 


See E REVIEW OF RESULTS 

From the remarks of the preceding section it follows that 
the limit cycle oscillations occuring in fixed-point imple- 
mentations of recursive digital filters can be analyzed 


using the deterministic approach. In this section the major 
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results of the following chapters ar2 previewed. 

Ins Chapter il, a lamear model jreerdraqi tal £1 liters sis 
developed. It is shown that the second-order digital filter 
emerges as the basic building block for the realization of 
higher order digital filters. Using the state description 
mmmcagital filters, the existence of 24 canonical forms for 
second-order digital filters implemented with finite pre- 
cision arithmetic is presented. Twelve of these forms, to 
the author's knowledge, have not appeared in the literature 
penore . 

my Section LL.D, the influence cf coefficient accuracy 
on the response of a second-order digital filter is con- 
Sidered. A new general expression for the shift of the pole 
Meewenlons Gue to truncation of the filter coefficient of the 
meena -order digital filter is derived. The poles or char- 
acteristic values are expressed in polar coordinates to 
correspond to damping factor and resonant frequency of the 
filter. Using two examples it is demonstrated that not only 
sampling too slow, but sampling too fast also may result in 
an undesirable response. 

ime Chapter IIT, limit cycle oscillations caused by 
quantization after multiplications are investigated using 
the simple model of a zero-input second-order digital filter 
with two poles and no zeros. The investigation is performed for 
magnitude $$ truncation and roundoff quantization. As a new 
result, it is shown that with magnitude truncation quantization in 
general no zero-input limit cycles can be sustained. On 
the other hand, zero input limit cycles of all frequencies 


es, 





are possible with roundoff quantization. A general matrix 
formulation of these limit cycles is presented. In general, 
there exists no known way to evaluate amplitude and fre- 
quency of the self-oscillations exactly. However, five ampli- 
tude bounds and an approximate expression for the frequency 
of the limit cycles are derived. Tee of the amplitude 
bounds are new. Two of these three are exact bounds, which 
iS in contrast to the previously known results which are 
based on an approximate analysis. Chapter III closes with 
the proofs of three new lemmas which describe some basic 
symmetry properties of the limit cycles if they are dis- 
played in a specially defined phase-plane diagram, cailed 
successive value phase~plane plot. 

mee Colevusions of Chapter Ill aremgyvecril ft ledmimeGnaeeer 
iV, where experimental results are reported and compared 
with the theory. For this purpose three computer programs 
have been written. The first program is an analysis program 
femezero-input limit cycles in second-order digital filters 
employing roundoff quantization. For a choice of values for 
Mie rilter coefficients, all possible limit cycles are 
evaluated in a given area of search and displayed in the 
successive value phase-plane. With the numerical values for 
mace limit cycles available, it is then easy to compare the 
actual amplitude of the limit cycle with the predicted ampli-~ 
tude obtained from the derived bounds. In this way, limit 
cycles have been detected which exceed the previously pub- 


lished amplitude bounds considerably. 
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The second program implements two of the five amplitude 
bounds derived in Chapter III so that a comparison between 
the different bounds is possible. One bound is shown to be 
impractical because it is overly pessimistic. For the 
remaining four bounds, the region oz applicability and their 
advantages are discussed and compared. 

The third program is a simulation of an important special 
case, the Cigital oscillator. It is shown that any degree 
of approximation for a specified sinusoidal oscillation can 
be achieved by either increasing the amplitude if the quanti- 
meeron step-size is constant, or by decreasing the quanti- 
Zation step-size if the amplitude is constant. In addition, 
jmiemcan be deduced that roundoff is preferable over truncatioa 
Meeause a better deqree of approximation can he obtained. 

The existence of constant amplitude limit cycles is contrary 
to a conclusion reached by Rader ano Gold [12] where it is 
Claimed that the output noise of the digital osciilator in- 
@meases linearly with time. The digital oscillator is an- 
other important example where the assumptions of the stoch- 
astic approach for the analysis of quantization noise fail 
be apply. 

The results of Chapter III and IV are generalized in 
Chapter V. The forced response of general digital filters 
with both poles and zeros is analyzed with regard to possible 
imst cycle oscillations. First, the forced response of the 
two-pole filter is investigated for deterministic inputs. 


As a new result, it is shown that the driven case can »e 
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reduced to a zero-input case if the difference between the 
response of the quantized digital filter and the corres- 
ponding linear digital filter is considered. This difference 
Binal is described by a limit cycle oscillation whose ampli- 
tude is estimated by the same bounds which have been derived 
mampcenapter III for the zero-input ree eee Next, the gen- 
eral second-order digital filter with both zeros and poles 
in the transfer function of the egquivalant linear filter is 
studied. The zeros are shown not to change the nature of the 
inegat cycle, but to influence the magnitude of the limit 
cycle amplitude. As a new result it is derived that for 
specified zeros the magnitude of the limit cycles in the 
fteoit Of the digital filter can be minimized through a proper 
maeiwee OL the filter configuration. Finally, higher order 
eaogatal filters of the cascade and the parallel form are 
considered with regard to limit cycles in their output. 
imechapter VI, the derived bounds on the limit cycle am- 
plitude are applied as a design guice to study tradeoffs be- 
tween the required number of Significant digits and the 
Peeewrted signal-to-noise ratio of a digital filter. The 
chapter concludes with an indication of those problems which 


remain subject to further research. 
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Il... SECOND ORDER DIGITAG int eR hO mn 
WITH FINITE PRECISION Akpiovie ere 

A. INTRODUCTION 

The realization of a linear digital filter requires per- 
fect arithmetic to perform the necessary additions and multi- 
plications with infinite precision; that is, an infinite num- 
ber of significant figures must be available. For practical 
moeerzations of digital filters, however, finite precision 
arithmetic has to be used. The linear, infinite precision, 
digital filter is thus an idealization which can never be 
fully realized by a digital computer. However, it is im- 
Pemrant to consider this type of digital filter to develop 
an understanding of the inherent nonlinear effects which are 
studied in this and in later chapters. 

First, a linear model for digital filters is developed. 
Tt is shown that the second-order digital filter emerges as 
Peaemioasic building block for the realization of higher-order 
medial filters. Starting with the state description of 
discrete systems, the existence of 24 canonical forms for 
m-eend-orcer digital filters implemented with finite pre- 
cision webeimetie, (1.e., da finite number sot wetontereane 
figures) is presented. The development is based on the con- 
@ept of transpose configurations of digital filters as de- 
vised by Jackson [2]. This method is extended to show the 
existence of a finite number of canonical forms and twelve 
new, previously unpublished, canonical forms are derived. 
The development indicates that 24 canonic forms are possible 


Poich have identical transter functions, even under the 
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assumption of finite precision arithmetic. However, their 
error properties are, in general, different. 

Second, the influence of coefficient accuracy on the re- 
sponse of a second-order digital filter is considered. A 
change ina filter coefficient does not affect the linear 
Mecure of the digital filter, but simply shifts the pole- 
zero locations of this filter. A new general expression for 
Mieeshirtt of the pole locations, due to truncation of the 
coefficients of the second-order digital filter, is derived. 
The poles or characteristic values are expressed in polar 
coordinates to correspond to damping factor and resonant 
frequency of the filter. The validity of the result is 
tested using some examples. The examples show that the posi- 
meonrng Or the poles and. thus, the verformance of a diaitadl 
miecer, 1S influenced by the choice of the particular filter 
structure and the sampling interval. It is generally known 
that sampling too slow may result in ae deteriorated response 
foe digital filter. On the other hand, it has also been 
demonstrated before that sampling too fast may also result 


in an undesired response [4]. 


Pee sODELING OF DISCRETE SYSTEMS 
Discrete systems can be implemented using the operations 
of delay, multiplication and addition. The interconnection 
of these elements will be represented by a directed graph. 
Following Gold and Rader [30], the rule or operator 
by which a discrete time output signal is determined from a 


Giscrete time input signal is expressed as 





ce 
(eas _ X(z) 
H (z) => N 7 = ie (20le) 
1) pee 
i=l 


iim (2.1) ga stands for the delay operator of interval 


T, and the a. and bs are constant ccefficients. N determines 
the order of the system (assuming either ay OF ba to be un- 
equal to zero). The z-transform calculus, used to describe 


H(z), plays a useful role in the analysis and synthesis of 
linear discrete systems similar to the role of the Laplace 
Transform calculus in the analysis of linear continuous sys- 
mems. H(z), above, is the transformed equivalent of the fol- 


en 


lowing N ordex difference equation [30], where x(nT) de- 


notes the output and u(nT) denotes the input: 


an 
ili 


[|r 
S 


N : 
a. uf(n-i)T] - }) b.xf[ (n-i)T] (Za) 
i 32, +1 


fen the notation which ys used throughout this dissertation 


N N 
x(n) = y a. u(n-i) - } bs Be (ii tt a (Zee) 


Since the present value of x(n) depends on -(N+1) or fewer 
values of the input u(n-i) and N or fewer values of the sig- 
nal x(n-i) the transfer function (2.1), or difference equa- 
meen (2.3) is of the recursive type. In this dissertation 
only recursive digital filters are considered because the 
inherent feedback causes the interesting oscillation pheno- 


mena studied in the later chapters. 
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It should be noted that recursive digital filters are 
often preferred over nonrecurSive types, because the former 
allow for a simpler realization in that lower order forms 
provide the same degree of approximation [4]. 

In the last paragraph, no mention has been made of the 
approximation problem, i.e., the problem of how the transfer 
function H(z) is obtained from the specifications for a 
@egjital filter. For the purpose of this dissertation, it is 
assumed that the approximation problem is solved previously 
emer that a particular H(z) is given. 

There exist a multitude of forms for realizing linear 
discrete systems. MHOWeVCE a elec canonical forms have been 
defined in the literature (see for example Gold and Rader 
[5]). These are the direct, the parallel and the cascade 
forms. No formal definition has been given in the literature 
Meera “Cancnical form". The following intuitive definition 
has to be sufficient. for the present. A realization 15 con- 
Sidered canonical if the discrete svstem is implemented with 
the minimum number of delays, multipliers and adders. Can- 
onical forms with respect to second:--order systems are studied 
an the next. section. 

PeereGalization of the direct form is shown in Fig. 2.1. 
Wm@eche other hand, the transfer function H(z) can be parti- 
tioned into second-order sections and then be realized in 
either parallel or cascade form. Second-order sections have 
been chosen because this is the minimum order for realizing 
a pair of complex conjugate roots such that the polynomials 


mimetLne numerator and denominator of the transfer Function 
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have real coefficients. Real roots can then be realized in 
pairs also, except for the case where N is odd, in which 
case use of a first-order section becomes necessary. 

ane parallel form corresponds co a partial fraction. —.— 


pansion of H(z) in the following way (assuming no multiple 


BOOTS ) 
an e157 ay 
eZ ee ae ) Sop ee (2,4) 
N T=] G2nZ +O eZ +1 
Zl ea 
where M = Be, indicating the integer part of Tr A 


Peemetquration of the parallel form is shown in Fig. 2.2. 
The cascade form corresponds to factorization of H(z) into 


the product of second-order polynomials, where 


ND 
| 


eee ° eed 


Peecontiguration for the cascade form is shown in Fig. 2.3. 
Kaiser [3] has shown that the direct form should be 
avoided because of coefficient sensitivity, i.e., the effect 
of changes of the numerical coefficients of the filter causes 

large variations in the filter response. 

Also, Knowles and Edwards [31] have concluded that the 
direct form is inferior to both the cascade and parallel 
forms when the effect of roundoff errors after arithmetic 
operations are considered. In a recent paper by Edwards, 
Bradley and Knowles [11] the above mentioned conclusions 
have been tested using the llth order elliptical bandstop 


mcer. laking scaling into account to assure €he preper 


28 








dynamic range for the filter, the ratio of the rms noise 
fevel due to roundoff after multiplication for the direce 
form, to the rms noise of the parallel or the cascade form, 
was about 1G sae 

Since the direct form is impractical, and higher-order 
Gigital filters will be realized as cascade or parallel 
form, the second-order system (with the first-order system 
considered a degenerate case) emerges as a basic building 
block from which all higher order systems can be synthesized. 
It is for this reason that the study of oscillations in 
discrete systems will be restricted to the second-order 
case. 
eer, SPACE DESCRIPTION OF SECOND-ORDER DIGITAL FILTER 

MODELS 

In this section the state descrivtion of discrete sys- 
tems is used to develop 24 second-order digital filter models 
under the restriction of finite precision arithmetic. Let 
a linear discrete system be described by the following set of 


state equations 


x (n+1). Po ett) } + B we iy 


vaeee Gx). Dy aan wine ie | (226 } 


u(n) denotes the input, y(n) denotes the output and x(n) 
@escribes the states of the system. A, B, C, D are con- 
stant coefficient matrices for the case of a linear, time- 
er iant system. Equation (2.6) can be expressed by cne 


matrix, called the system matrix §S Suen ciate 


NS 
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eins sa 
S 


N (2 Lae 
y (n) 2(n)| 


The system is then completely defined by the matrix Sx which 


is given by 
S., = ; (22; 7) 


where N denotes the order of the system. 
The transfer function H(z) for a single-input single- 


output system is defined to be 


—_. 


ar = HZ eet |. (208) 
1 
Then, from (2.6) and (2.8), H(z) can he evaluated as~ 
= 
H(z) = C(zI-A) Bee Cs (225) 


ii 2.9), I represents the identify matrix. AS was pointed 
out in the previous section, digital filters are usually 
realized by either cascade or parallel second-order forms, 
omenat x(n) is a 2 x 1 state vector. The most general 
Megietrax for a second order digital filter is the following 
(where the subscript N = 2 is dropped, since the second- 


order case is the only case considered): 


AB A440 FQ 
C= Any Ao bo . | (722.00) 
C d Cc Cc d 
1 2 


“~ 


Ji 
In matrix equations lower case letters denote scalars. 
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Let a filter transfer function with coefficients a -weomeer 
d, e be given as 
eZ + CZ 


H(z) = d@ + —S5——S4___ Gain 


Beeem (2.9) - (2.11) the filter coefficients, in terms of the 


Meeanster function coefficients of (2.11), are given by 


a = (a4 + Ano), (2.12a) 
a A314 859 7851 F198 erelly7.6))) 
c= bic, + boot (2A G) 
e= Ay obocy + a51b1c> _ 21 425C5 - Anob Cc): (2.420) 


Tf infinite precision arithmetic is used, many canonical and 
noncanonical configurations can be found to realize a parti- 


emer H(z). Since the coefficients a, b, c,e are given by 


/ 
the transfer function as determined from the solution of the 
Approximation problem, it is necessary to find Arye Ayan sees 
etc., so that a state variable synthesis of the digital fil- 
ter becomes possible, Any combination of ae by and Ca! 
mien yields the given values of a, b, c and e is a valid 
realization. 

However, for any practical implementation finite arith- 
metic multipliers and adders have to be used. Suppose that 


the filter is realized using binary arithmetic elements 


With k-bit accuracy, then (2.12a-d) have to be rewritten as 


ea +a (2 ,13a) 


~ (ayy 22)4 


ab 





b lay o0]Q = Lay 24 4: (2 sei) 

c= Dee 4. ens Oe ere) 

Se te Ca eeal ome 22 nb oot ae 
“[ag9b,¢,1,- (2.134) 


The operation oe denotes quanti Zatron (round Oimsre is 
truncation) to preserve the finite precision of the results 
of mie MM pdt CakiTon. 

Given H(z) with coefficients a, b, c, d and e, a general 
Sewution of (2.13a-d) is not obvious for the coefficients 


cae. , D 


49 ec in terms of a, b, c, d, e, because there are 


four equations in eight unknowns, which leaves an infinite 


variety of choices to be made for four of the eight un- 


Knowns. Furthermore, the existence of a solution for (2.i3a-d) 


is not guaranteed at all. 
The validity of the latter conclusion can be demonstra- 
ted with the simple example of a digital oscillator, reali- 
zed by two coupled first-order sections. The example is 
presented in the next paragraph. 
Consider a digital oscillator realization with an S- 
Metrix Of the form | 
cos WOT sin W oT 


SSK we Cos WE C2ene) 
Oo Oo 


Al 0 





The z-transformed response of this section to initial 


@onaitions x, (0) = 0, Xo (0) = 1 is given by 


32 





Ee in wT 
Y(z)} = oe (2 ola) 


Zz, 2 -~227 cos Wo T+ 1 





Thus 


II 


a -—2Z cos UT, 
Oo 


Se 


and the poles of the response have magnitude one (because 
A441 Aon 789 291 = 1), which is the necessary and suf- 
miewent condition for oscillation. 


The filter coefficients Sad are specified by binary num- 


Mers with k bits. Therefore for a specific WOT 


- Py 
Ai, = 4g9 = COS WT = 5k (25286) 
~ a= — axis anata ae mi = Po an 7 7 A 
45 — Soul —— ee ik oe —— a CAs Lolo) 


where Py and Py are the decimal representations of Ary and 


born Of which must be divisible hy AA Rico (2 os mecinc 


aio! 
eee >) 6it follows that 


p p 
eee (2.18) 
2 2 : 


This requires that 


eee (2.19) 


In general, for a given Wot, the numbers for Py and Po which 
eeeesty (2.19) may not exist. Actually, as will be seen 
later, only a finite set of frequencies can be realized if 


mmnite warithmetic is used. 
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Returning to the set of equations (2.1]13a-d), it remains 
a problem for further research to investigate the existence 
and ec Ure oe) general So UE Ont Oates Se Qt saa ce 
ben ec solution for) (2.l3a=d) will be simp] eed aaeace 
somewhat restrictive, but intuitively plausible assumption 
that quantization of product terms can be avoided if the pro- 
ducts in (2.13b-d) contain at most one noninteger coefficient. 
If two terms are contained in the product (for example, see 
(2.13b)), a necessary condition is that one of these be an 
integer. If three terms are contained in the product (for 
example, see (2.13d)) a necessary condition is that two of 
them be integer or one of them be zero. With this assumption 
in mind, four integer coefficients have to be selected to be 
able to evaluate the remaining four coefficients. By in- 
Beection of (2.13b) and (2.13c), it can be deduced that two 
Se the a5 coefficients and two of the b,/c, coefficients 
have to be selected as integers. 

The resulting sixteen possibilities (for example select 
me 712" 1° %1 Teepe ak aca 


gated separately by substitution of each set of selected 


Sao a as integers) are investi- 


integer coefficients into (2.13d) and application of the 
following set of rules: 

a) An individual product term in (2.13d) is formed without 
quantization error, if either two multiplier coefficients 
are integers or one multiplier coefficient is zero. 

b) It is impossible to have b, = b, = 0, or c, = c, = 0, 
because these conditions imply fno provisioli for inpus 


and output. 


c) Neither a M@ie at are allowed to be zero, because then 
(2.13b) cannot be solved unambiguously for aj, OY 45)- 
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G@) If a Menzerosmultiplier eect atecrenterc cecum meemae 
an integer, then the integer 1 is chosen, because in 
in this case no muliplier is needed in the practical 
realization. 


As a demonstration of how the above rules are applied, 


consider the choice of Aoz1 Anos Dos Do as integers. Sub- 


stituting these integers into (2.13d) shows that the terms 


(aj> b. C,) and (ayy Do Co) contain only one integer coef- 


ficient, namely b, and by rule (a), it is required that 


Z 


bo = 0. From rule (b) and (d) this requires that by = 1. 


Since, except for rule (d), no further restrictions exist 


ome remaining integer coefficients ao1 and Ayo Can elther 
be chosen as Ay, = Agn = Leer a5, = 1 and ao5 = 0 (the case 
where a,, = 0 and Ao 5 = 1 yields no new result). Substi- 


tuting the selected coefficients into (2.13 a-d) yields the 


Mago nine four cceeffacrents a2 a Sc. and @, anc thm 
ey lee oe 2 
fwe distinct S-matrices result. They are 
~] 
-a —b 1 —(l+a) —(l+a+b) a 
Se == L 0 0 oe 1 1 O12 220 
A ' b ( ) 
Cc e d Cc (e+c) Gi 


Another choice is to select An yr Anos b c. aS integers. 


eZ 
However, from (2.13d) it 1s seen that the term (as5 bo c,) 
Contains no integer coefficient at all and by rule (a) the 
above selection does not lead to a solution. 
.Working through the remaining 14 possible selections for 


integer-coefficients, six more S-matrices are obtained. They 


are 


So 





-a 1 e -—(l+a) ae é 
S = |=bo 0 ew Ss -(ltatb) 1 £4(e+tc) 52 a2 Ae 
1 0 d 





0 Ll 0 il: 1 ¢ 
Sa =j-b -a tee Se = }=(l-atb) -(lta) 1 wate. 22) 
e c a (e-+c) Cc d 
| o —b “| -(l+atb) (e+c) 
7 ={ ] -a | , Sy = ~(lt+a) Cc Re eee, a) 
| 0 1 df 





al d 


can be derived from the eight S-matrices. Furthermore, 
or a 


So = S33 and Sq = Sas Jackson [2] has @showietiae tor soem er 
Seeer Conficuration for a digital filter, oe le Uta aie. 
“transpose configuration" for the transpose system, S nS 
femeaved from the given configuration for _ by 

a) reversing the direction of the signal flow in the 
given network, and 

b) changing all summation nodes in the given configura- 
fmmem into pickoff nodes in the transpose configuration, and 
changing all pickoff nodes into summation nodes. 

Jackson has also shown that a single = matrix and its 


TH 


1 . eee 
transpose Pe can be realized by twelve different conficura- 


tions, because the elements of the S.. matrix are not 





necessarily in one-to-one correspondence with the multi- 
pliers in the flowgraph for the filter realization. 
Since there are only two uniquely different = matrices, 


S., and S and each has 12 different: realizations, there are 


ae 
pesadifferent configurations for a given transfer function 
foe, if the restriction of k-digit arithmetic is imposed. 


These 24 configurations are given in the next paragraph. 


Two parallel forms for d = 0, and two cascade forms for 
d= 1 are derived from Sa and Sa = Se Tt shoullia- be noted, 


ilgecomparison of (2.11) with (2.4) and (2.5), that a second- 
@eder section becomes a parallel form (compare with (2.4)) 
when d = 0. Similarly, a second-order section becomes a 


cascade form (compare with (2.5)) when d = l. 


; Z ee : : Al = 
Minestour forms are desioqnated S_. . S... GS » Si... They 
7 ay ae an an 


are described by the following Sa matrices and drawn in Figs. 


eea—-2.5. 
e =e i 
S = a 0 O]. (257 4) 
al 
Sc e d=0 
-a —b AL 
S = 1 0 0 (24255) 
ag? 
ec e a=) 


The next eight configurations are cascade forms with 
AE 
a t 


ee i. Two direct forms are derived from Sat and S ; 


where 


De 





S = 1 0 0 (271260) 
a3 
CG a ea Oy ew. 
Here, g = (atc) and £ = (etb). Their configurations 


@—@e displayed in Figs. 2.6-2.7. The new multipliers g and 
Mere Obtained by shifting the first pickoff£ node in Fig. 2.5 
to a position after the first summation node (compare Fig. 
Mmoewoath Fig. 2.6). That a new configuration results is 

due to the fact that the elements of the = matrix are not 

nT) one-to-one correspondence with the actual multipliers in 


mien itlow graph representing the configuration. The forms 


T T a 
metro , o , S_, § and. Sonne are shown by Jackson to 
ad ag A5 ar ag ag 
be Of minor Liuportance. They wail not be repeated here. 


Twelve new configurations which have not appeared in the 


literature hefore are now derived from Sp: Two parallel 
forms, with d = 0, and two cascade forms, with d = 1, are 
derived from S et and §S ae 
oe mod bom 
-(l+a) -(l+atb) 1 
SS 1 re Omer (22 1) 
by 
e (e+c) d=0 


-—(l-+ta) —(l+a+tb) i 
S = 1 ui 0 : (2323) 


e (e+c) oe 
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Their configurations are displayed in Figs. 2.8-2.9. 


The remaining eight cascade forms require that d = ]. Two 
direct forms are obtained from Sy and Ss. , where 
3 3 
-(l+a) -(l+a+b) iL 
eb. = JL a Opie (2.29) 
e-= (la) f- (l+atb) iE 
Pere, g = (l+tatc) and f = (ltatbtcte). Their configurations 
Meemshown in Figs. 2.10 = 2.11. The other forms are obtained 
from 
Cah (e+c)-r i. 
S = Ae a Cala (2 225100) 
ba 
Lc (eae) 1 | 
ch —(l+atb) | 
= Zoo 
=e 1 il Ootes, ( ) 
Cc f-(lt+atb) 1. 
—(l+a) (e+c)-r 1 
S a ul Fs: (232) 
b¢ 
dies ate) (e+c) 1| 
where h = (lta) + c and r = (ltatb) + (etc). Some of their 


Gonfigurations are shown in Figs. 2.12-2.14. As was pointed 


Mere carlier, the transpose configurations can be obtaaned "ie 





reversing the signal flow and replacing summing nodes by 
pickoff nodes. 

It is worth noting that all of the derived 24 configura- 
tions have two delays and four multipliers. However, the 


number of summing nodes and pickoff nodes varies between 


two and four. This 1S summarized in the following table: 
Summing Dar s@reee Configuration 
Node Node 
2 2 s_, st 
aj a] 
T 
S 
2 3 ae et Ode by 
3 : 2 Se ee oes 
G2 B27 a a 
oe i f 
3 3 S ) z ’ S ’ os ) S ’ : 
85; a5 26 ae bro Py 
oof . it 
“bo? ba’ “bz” “bz 
cz 
Ly e ae Spe 
3 l Sess 
: 7 


In a theoretical sense only forms | and S_, are canonical. In e 
practical sense a tradeoff between hardware requirements (number of 
multipliers and adders) and noise performance has to be found. 

It remains a subject of further investigation to evaluate the 
noise performance of the newly derived twelve forms using the 
methods devised by Jackson [2]. Furthermore it remains to formally 
define a "canonical form" and relate the order of the difference 
equation to the necessary number of delays, multipliers and nodes 


MmMiecne actual realization of a digital filter. 
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bee THR EFFECT OF COEFFICIENT ACCURAGY ON THE PORE Ve@si Ties 
OF SECOND-ORDER DIGITAL FHURERS 


The poles or eigenvalues of a given transfer function 
H(z) can be evaluated from the characteristic equation of 


ieee) which is given by 


2° +arciZ,  taeou == (2-2, ) (z-Z) = O. (23) 


Mresroots of the characteristic equation or its eigenvalues 


eee found to be 
—_ — a 1 —_ a 


This pair of complex roots is expressed in polar coordinates 


_~ 


as follows: 





eae =r = Vb, (2.35) 
=all aa 

PSeGis Z = = @ = cos ( on (2 236) 
ez 2\Vb 


At this point let us digress to find a relation between 


magnitude and argument of the poles 2 and the notions of 


2 
damping and frequency, as they are defined for linear, con- 
tinuous systems. 

For a second-order continuous filter with a dampea sinu- 


soidal impulse response of the form eee 


Spon Wots ROVE ae 10s, 

the roots of the characteristic equation are located at 

a= — 0 =e where s equals the Laplace transform variable. 
If this response is sampled at intervals T, the poles of 


the z-transformed version of the response are given by 


2aT 


a cos w oT ae Sai (Zoe) 


z* aoe 
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@emparing (2.37) with (2.33) i foes. chat 


a = aoe EOS aT, (2ig3 8) 

pee (2.39) 
memethat from (2.35) and (2.36) 

IZ I =rsae tt, (2.40) 

Arg ee = 9 = Wor. (2241) 


Thus (2.40-41) can be used to compare the impulse response 
of the digital filter with the sampled impulse response of 
a continuous second-order filter. It can be deduced that the 


polar coordinates r and 8 of the pole positions z are a 


ee 


WIT RI EN nt 
aetna ws KL WL 


4. =~ An mvs cle we. ve me z iseaecst (Pas é yee ' c ’ 
ease UA ACLUL W aliu LIIC LEHVIIaINe LECQuelvcy 


Wo of the equivaient continuous filter. The position of a 
pair of complex roots which would result in a stable digital 
filter response is shown in Fig. 2.135. The stability boun- 
dary is given in the z-plane by the circle described by 
P= 1. 

Let us now turn our attention to the effect of coef- 
ficient accuracy on the pole positions. Expressions are now 
developed Prion show the deviation of r and WS from the 


nominal values if a second-order digital filter is realized 


With coefficients represented by finite computer word lengths. 


Let Bye = nominal filter coefficient, 
Sipe 1G coefficient expressed by a finite computer 
oY 
word ® 
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The deviation from the nominal coefficient is then expressed 


by 
= ee t 
ae a ai4 ; (242) 
Note that Aa, , = Ojp ede oe = 0 or 1. For small changes in 
Eme coefficients ae as given by (2.42) the changes in 


r and @ depend only upon the A-matrix from (2.10). These 


changes can be approximated by 


























ox ox ox ox 
Ar = Aa Te - Ka + Aa + — Aane “ore 
and 
06 08 06 00 
A@ = Aa 5 Aa + x Aa “ Adake Zoe) 
Jay4 ee 98,5 12 8An ou Jano 22 


mae partial derivatives are evaluated using (2.35) and {2.36) 


which are repeated here for convenience: 


r = (> =Va,, Any “Ayn Any : (29545) 


a +t a 
=d Pel Ze (2.46) 


a: 


2877259 7 897419. 


These partial derivatives are 











a 
oe 2 222 (2.47) 
11 
a 
Cie 21 (2.47b) 
Jay 5 Oe 
a 
ieee ke (2.47c) 
Jay 4 De 


43 











oe ps) ae 
ae (2.474) 
. | 2 
Gi fo ee ie 
a en (2.48a) 
11 4xr”™ Sin 6 
aia ta see 
cue icon 222 
9A, 5 “ 4 aS : ' (2.48b) 
yA 1g Sin 
ie Seine oS 
Ja, 7 ss oe ; (2.48c) 
Yr oi 
2 
ee cope 4 Oe ae - 
AA = EES a a ar —_—— —, : (2540) 
me _ 4r™ sin 6 


With these expressions substituted into (2.43) and (2.44) 


s e 2S “pe * pe s =| 
SEmovwing Genoxral weisuit is schtained: 


the 


th 


~~ i — 
Ar = 57 (Ang 48,4 7 pz A8z9 7 8, 9485, + 81748 59)) (2.49) 
a J { (- al + 2 a + 2 )A 
— 35. LoD 199 wee eo 
a Sin 6 
— (8,485, ~ 859891) 48,5 ~— (4,78 19 + 8n0%] 9) 485, + 
+ ee + 2a..a - a,.a..)Aa..] Ce SO} 
na 12°21 11222) 4450! - 


This general expression for the shift in pole positions 
Seeene Second-order digital filter due to finite accuracy in 
the representation of the filter coefficients is a new 


result. 





mrom (2.40-41) it follows that 


Aw = - SE Qt: (2 55) 
7 . 

Nee (2.52) 

O = m a, } 


The Eqs. (2.51-52) indicate how a change in the pole position 
Seecne digital filter is reflected in terms of a corresponding 

change in damping and resonant frequency of the sampled continuous 
fiver. The significance of the derived results are now tested using 
two examples: 


ieee Oscilgator Realized by Two Coupled First-Order Difterence 
Eque tions 


_- 


ae o-Matvrax for this type of oscillator is 


| eas «TP Sate Q | 
| O O | 
Cae =sin Wy cos wT 0 . (Zapp) 


i 0 0 


Assuming all Aa, to be bounded, it is possibie to define a A such 


that 
Jaa] < A, | | (2.54) 


The changes in r and @ are bounded by 
ree (Sin wT + Cos WT), (2555) 
(ORE) (COS WT - sin WT). (2.56) 
From (2.55), it can be seen that through proper choice of the ratio 


. en 
between oscillation freauency W, and sampling frequency w, = =, AQ 


mee De mde alroset zero. “nus if 


1, 





S 


mae 0 from (2.56)9 WoT = 7 and = a However, for this 
S 


ratio the change of damping from the desired value of 1 for 


an oscillator is a maximum as indicazed by (2.55) when 


Si : ~ Sa 

OT c 7° Conversely, if Ar Oo Lame (2s 556)7 We Tee ers 

and — — gs However, Lor this ratio the ehange orescence] 
S 


quency iS a maximum as indicated by (2.56). 

This result would indicate that, if one desires an oscil- 
lator with exact frequency (A@ = 0), then the realization by 
(2.53) shows a damped response because of finite precision 
an the coefficients. Alternately, it would indicate that a 
@emasOoidal oscillator is possible (Ar = 0), but the frequency 
would not necessarily be at its nominal value. This pro- 
blem is discussed further in Chapter IV, where it is shown 
Meee the effect of quantization exmmors after miiltiplication 
Of data samples with coefficients is to introduce nonlinear 
femee cycles, so that a constant amplitude oscillation 
(Ar = 0) can be peneraced ii practices 


meee Osc-llator Realized by One Second-Order Difference 





Equation 
2 cos w_T -1 0 
O 
S = i 0 ON Re (25s 
ile 0 0 


Using the inequality (2.54) the changes in r and Wo are then 


bounded by 


ie 0 (because ao ieee (225109) 
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A 


6. 2 Tica WT 


‘ : (2159)) 


As can be seen from (2.59) sampling too fast (T and sin WT 
are small) inay have a deteriorating effect, because AW, 
can get intolerably large. 

Equation (2.57) is of the same form as the S-matrix 
(2.24), which has been used previously to derive configura- 
tions for second-order filters. For the S-matrix given by 


(2.24), the changes in r and @ are bounded by 





1 A 
— 2 
2Vb 
- Qh-a A i il 
Aw < A ae (= —————-—____- at pe  ) 
ae 2Tb V 4b—a- z ax sin woT  9y4tan wT 


MeO} 

Meein, from (2.61), it can be seen that sampling too fast 
can have a deteriorating effect on the digital oscillator, 

Gr in general on a digital filter. This may become especially 
critical for narrowband low-pass filters, where both Wo and 
T are small. 

It is instructive to show Cher drstnibutaon or thesactual 
pole positions in the z-plane .for the digital ieee sO 
examples 1 and 2. Suppose that a digital filter is realized 
by £1xed-~point arithmetic using 3 bits without sign-bit 
memeealize the filter coefficients. Thus there are a = § 
Pessible coefficient values for the ass terms. The set of 
realizable pole positions for the digital filters of example 


meand 2 are displayed in Fig. 2.16 [18]. 
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Comparing examples 1 and 2, it can be seen that for a 
nominal set of pole positions, the effect of finite word 
Mength for the r is to cause a uniform change in the pole 
meeations over the z-plane for the realization of example 1. 
mes 1S in contrast to the nonuniform change for example 2, 
where the possible pole positions are crowded around 

I ey ii 
w T = = , which corresponds to — = 73. If the nominal values 
O 2 Wa 4 
ioe =the ai5 Ss places the pole locations in a recion areund 
WOT mueor j| , then the etfects of a finite number of dreres 


is to cause a large effect with the realization of example 


er 


aoe DUMMARY 

mnie purpose of this chaper is twotolid. FPisst, some 
concepts about linear discrete systems were introduced, which 
are needed for the understanding of later chapters. 
Second, two new results were derived. The linear model for 
second-order digital filters was described and 24 canonical 
Seeeuit representations, under the assumption of k-digit 
accuracy, were shown to exist. It is important to note that 
pele 24 configurations have identical transfer functions, 
even under the assumption of k-digit accuracy. However,their 
error properties are, in general different. Furthermore, a 
@emeral formula to predict changes in pole positions due to 
Binges from the nominal values of coefficients because of 


finite representation of numbers was derived. 
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Some exemples were used to demonstrate that with finite 
arithmetic the linear digital oscillator cannot always be 
realized to meet a given specification. Also, the sampling 
frequency, Os effects the pole locations of the digital fil-: 
ter realization. 

There remain three problem areas for which further re- 
search is necessary. The first is a topological problem. A 
meme! definition for a "canonical form" is needed. Also, 

a Pistion between the order of a difference equation and 

the minimum number of delays, multipliers, summers and pickoff 
meees constituting a canonical form should be found. It is 
well known that the order of the difference equation corres~ 
ponds to the number of delays and Ehae Ene nunbern sor ne ne 

zero and nonunity coefficients in the difference equation 
corresponds to the number of multipliers needea. However, 

a Similar correspondence is not clear for the necessary num- 
ber of adders and pickoff nodes. 

The second problem concerns the general solution for the 
Set of equations (2.13a-d). Conditions for the existence 
and the form of a possible solution need to be investigated 
in more ea 1, 

As a third problem, an Daas CALCOT of the roundoff 
noise properties of the twelve newly derived second-order 
digital filter configurations is necessary. 

Peter modeling of the second-order digital filter under 
meme restriction of k-digit accuracy, and after investigation 
@e the effects of finite precision arithmetic on the pole 


Mesittions of a digital filter, quantization of products of 
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data samples with filter coefficients is considered in the 





next chapter. 
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Big. 2.12: A Realization of the Second-order Digital 
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Fig. 2.13: A Realization of the Second-order 
Digital Filter Using Forms, . 
> 








> 
> 





Fig. 2.14: A Realization of the Second-order 
Digitale eer Ue tng) Quem bee 
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III. ZERO-INPUT LIMIT CYCLE OSCILLATIONS 
IN DIGITAL FILTERS 
A. INTRODUCTION 

imatial experiments performed with digital filters 
meowed, to the surprise of the designers, that these filters 
Beet into seifsustained oscillations, if spurious input 
Signals or no input at all was applied. 

mme Stability properties of linear first and second- 
order digital filter subsections are well known. However, 
the implementation of these systems with digital hardware 
introduces inherent nonlinearities which tend to make the 
Original stable system unstable. While the finite dynamic 
range of the impiementation assures bounded-input bounded- 
S@eput Stability, an asymptotically stable linear digital 
fmeter may, after the introduction of the nonlinearities 
become marginally stable (the oscillations are bounded) 
but not asymptotically stable (the natural response does 
Reteapproach zero). 

To be able to analyze the nonlinear effects on the re- 
sponse of digital filters, it is necessary to consider the 
mee Of arithmetic used, and the type of nonlinearity in- 
meeduced into the digital filter through finite precision 
eeithmetic. 

One type of nonlinearity is connected with the adders in 
eme digital filter realization. If numbers are added whose 


Sum exceeds the dynamic range of the aader "overflow" occurs, 


CY) 
~~} 





Benereby creating a severe nonlinearity. Limit Cycle Gseil= 
lations due to overflow have been investigated by Ebert, 
meme! (32). One of their important conclusions is that 
selfoscillations aay not be present if the adder is modi- 
fied so that it saturates when overflow occurs. For the 
purpose of the following chapters, it will be assumed that 
the adders in the digital filter are linear and overflow 
effects can be neglected. 

The other type of nonlinearity is connected with the 
multipliers in the digital filter. If two numbers are multi- 
plied the product has to be rounded off or truncated in or- 
der to preserve the finite representation of all numbers in 
the digital filter. This quantization of the results of 
eel piication of data samples with filter coefficients can 
also cause selfoscillations. For floating-point arithmetic 
Sandberg [23] has shown that a digital filter realization 
moll be asymptotically stable if ae damping of the iitamiiee 
precision counterpart of the digital filter is sufficiently 
"large" relative to the number of bits allotted to the man- 
meee of the data. Under these conditions limit cycle re- 
sponse to a eo oaee or to an input sequence that approaches 
mero is also ruled out. Thus limit cycle oscillations are 
mot a problem when floating-point arithmetic is used. How- 
Meeaeras pointed out in Chapter I, digital filters gencrally 
employ fixed-point arithmetic for which limit cycle oscil- 


Maietons may occur. 
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Therefore, in this chaptex,, selfoscillatidens cameeamo, 
quantization after multiplications are investigated. The 
semple model of a zero-input second-order digital filter with 
two poles and no zeros is used. This simple model is employed 
because it allows the study of the natural response of the fil- 
ter without the distracting influence of zeros in the transfer 
Pamction. 

The chapter begins with the description of the two most 
often used quantization procedures in Section III.B. These 
are roundoff and truncation. Their input-output character- 
istics are presented in this section. 

In order to develop some of the analytic techniques to be 
used in later chapters the effects of quantization are demon- 
strated with the example of a first-order digital filter. 

This case of the first-order section with roundorr quanti- 
zation has already been investigated by Blackman [24]. Asa 
new, additional result it is shown that a first-order oie 
tal filter with truncation is always stable. The second- 
order filter is then investigated. 

First, roundoff quantization is considered in Sections D,E,F; 
then magnitude truncation quantization is investigated in the 
last section. There exists a fundamental difficulty in the 
analysis of quantized second-order digital filters. The 
fact that there is one nonlinearity connected with every 
mmitiplier in the feedback paths of the filter complicates 
any analytical investigation of the nature of the limit cy- 
cles. There exists, in general, no known way to evaluate 


amplitude and frequency of the selfoscillations exactly. 
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As pointed out in the introductory chapter, a good deal 
of literature is available where the effects of the quanti- 
zation nonlinearities are investigated from a statistical 
point of view. However, the necessary assumptions of 
statistically independent and uncorrelated quantization 
noise sources are no longer valid if limit cycles are con- 
sidered. For this dissertation the effects of the non- 
linearities are investigated from the point of view of cor- 
related signals and a deterministic analysis applies. 

If selfoscillations are a problem and if it is necessary 
to keep the magnitude of the limit cycles below a specified 
Signal level, bounds on the amplitude and approximate ex- 
pressions for the frequency are desirable. Therefore, 
several amplitude bounds are presented in Section IITI.D and 
an approximate expression for the frequency of the limit 
cycle is presented in Section IITI.E. 

The first amplitude bound is a new result and is derived 
using Lyapunov functions to estimate the magnitude of the 
dynamic response of discrete systems with bounded input. 

The applied analytic technique first appeared in a paper by 
Johnson [2] devoted to the stability of a class of sampled- 
data control systems. For the purpose of this dissertation 
Johnson's technique is modified in Appendix A. The theorem 
proven in Appendix A is applied in Section III.D of this 
chapter to estimate the bound on the amplitude of the limit 
cycles. The importance of this bound rests in the fact that 


it is obtained without reference to the specific nature of 
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the roundoff error. It is only necessary to know that the 
roundoff error is bounded. Furthermore, it is proven that 
limit cycles always exist if roundoff is employed and the 
momcos Of the infinite precision digital filterware inside 


an annular region in the z-plane which is defined by 


owas 


eee |z| < 2.0. 

After the treatment of the Lyapunov bound, a general 
matrix formulation for the limit cycle and its amplitude 
bound is presented. These results are new and complement 
the previously mentioned bound. They also serve to provide 
a better understanding of the nature of the limit cycle. 
Both of the mentioned bounds are imoortant because they are 
absolute bounds. However the Lyapunov bound is pessimistic. 
This will be demonstrated in the next chapter where numeri- 
eee vyaiues for the two bounds are compared. 

A third bound is demonstrated to exist. It iS an approxi- 
mate bound. Its derivation is based on the postulate that 
roundoff quantization moves the poles of the digital filter 
emeOo the unit circle, thus providing a sufficient condition 
for oscillation. The underlying model has been first re- 
mercea by Jackson [27], who called it the effective value 
linear model. The importance of this third bound rests in 
the fact that the bound is rather tight and easily appli- 
cable in a practical sense. Its disadvantage lies in the 
fact, that the derivation of the bound is based on a suf- 
ficient, but not necessary, condition. Examples are stated 
where the bound obtained from the linear model is exceeded 
by two or more quantization steps. This is contrary to the 


v1 





findings reported by Jackson. Therefore, compared with the 
first two bounds, this amplitude bound is only a rule-of- 
thumb which is convenient to apple 

In Section III.E some results about the frequency of 
ie limit cycles are developed. Since the frequency is a 
highly complicated nonlinear function of the argument of 
the complex conjugate poles of the filter transfer function 
and the resulting amplitude of the oscillation, it is only 
possible to formulate an approximate expression for the fre-- 
quency, based again on the linear model. 

A new result about the symmetry of a specially defined 
successive value phase-plane plot cf the limit cycle oscil- 
lations is presented in Section III.F. The lemmas proven 
in this section assert that anv limit cvcle oscillation from 
| filter with poles in the right half of the unit circle in 
the z-plane is equal in magnitude to the response obtained 
from a filter whose poles are the mirror image of the origi- 
nal poles projected into the left half of the unit circle 
in the z-plane. 

Finally, in Section III.G, magnitude truncation quantization is con- 
mreg@ereaq. As a new result it is shown, that no zero-input 
limit cycles with intermediate frequencies other than 
f = 0, it. can be sustained. 

In summary, then, the results of this chapter describe 
some theoretical aspectsabout selfoscillations in digital 
friters due to quantization after multiplications. The 
conclusions of this chapter are verified in the next chapter, 
where experimental results are reported and compared. 
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B. DESCRIPTION OF THE QUANTIZER NONLINEARITIES USING A 
Mino r-ORDER DIGITAL FILTER 


The two most often used quantization procedures are 
a) rounding to the nearest integer, and 


b) truncation, where the least significant digit of a 
number represented by sign and magnitude is dropped. 


Other quantization procedures are possible. However, 
they are not used often in practice and are not considered 
here. First, let us study roundoff quantization. 

ie Parst-order Deadbands (Case of Roundoff). 

As an example to develop some of the analytic tech- 
Nigues used in later sections consider a first-order digital 
filter as shown in Fig. 3.1. For zero-input (u(n) = 0) 


this system can be described by the difference equation 
x(n) = ax(n-l). (S278) 


In Fig. 3.1 the roundoff quantizer Q is inserted into the 
System. The input-output characteristic of this type of 
nonlinearity is displayed in Fig. 3.2. Assuming a normali- 
Zed Quantization step-size of g = 1, (3.1) has to be re- 


written as 


Pin) eal x(n=1)], =a ahaa + 0.5 + 6(n), (3.2) 


A 
where f--), denotes roundoff to the nearest integer, x(n) 
denotes the nonlinear response of the filter and §(n) is any 
number such that 0 <7o(n eee Blacknan (24st teste res 


ported on the nonlinear effect of roundoff in first-order 





filters and called the phenomenon "deadband-effect". The 
following examples illustrate this. 
A 
memes = 0.9 and an initial condition of x~(0) = 16 the 


response is computed from (3.2) as shown below. 


computed error rounded 
n in) = (0 easy 1 (n) = Ceo or = tree x(n-1)) 
0 = | = 10 
i p 
2 : 8 
3 7 ‘ a 
4 6 
> S 
6 - : 5 


A similar result with changed signs is obtained for the ini- 


“Aw 





MEO tion x10}; = -10, For the anitial candigion 
x (0) = 4 tne following response is calculated. 
computed error rounded 
n mim) = 0.9 x(n-1) }0.5 - 6(m)| x(n) = [0.9 x(n-1)], 
50 
Oa Oi.4 
As the examples suggest, the system response for a = ¢.9 does 


memego to zero but remains at steady-state values between 
=) and +5 depending on the initial conditions used. It was 
for this reason that Blackman coined the term "deadband- 
Berect” for this kind of response. For a = 0.9 the first 


wa 


Seager deadband is within the limits x(n) = # 5. 
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The existence of a deadband is cefrfined by the equation 
ea = Ga) (343) 


for all n greater than some integer N. Depending on the 
mee and the magnitude of the filter coefficient a, three 
Mueroic cases have been considered in the literature to 


@erive the first-order deadbands. 


moO < a < 1.0: 


Se 


Bisa 1S positive,one finds by inspection of (322) 
that the sign of x(n) is equal to the sign of x(n-l) and the 
existence condition (3.3) for the deadband can be written 


as 


Bn) a ee) i pees (ce) 


mms a zero-frequency limit cycle results i Subsii tumaic 
(3.4) into (3.2) together with 0 < |é|< 1.0, the bound on 


the amplitude is evaluated as 


© 


* 2 
|x (n) | = 5 : (O00) 


me -1.0 <a < 0: 
If the coefficient is negative the signs of x(n) and 
X(n-1) alternate and the existence condition (3.3 Gb Ow sere 


deadband can be written as 
x(n) = -x(n-]), n > N. (a, 


Here, a limit cycle results where the ratio of oscillation 


28S 


frequency E to the sampling frequency fe is fo/t. = 


oS 





because two samples are contained in each period of the limit 
cycle. By the same method as above the amplitude bound is 


evaluated as 


¢ 0.5 _ 0.5 
CoE ES Tera, a al Can) 


2) a>il1.0 or a <* =-1.0: 

For these values of the coefficient a the corres- 
ponding linear system is unstable. Depending on the initial 
condition an increasing response or a deadband can exist. 

If a deadband exists then its amplitude bound, as in the pre- 


ceding sections, is found to be 
On 
xin) | _ (3.8) 


feeenis point an interesting observation (first reported by 
Jackson [2]) can be made. The existence condition (3.3) im- 


plies that 
Sn) = .a' Beh ls) (3.9) 


Mefeme a’ = t+ 1. FE (3.9) is z-transformed and an initial 


condition x(0) is assumed, then 


k@) 2 = (3.10) 
ee 


Here X(z) denotes the z-transformof x(n). From (3.19) it can 
be seen that the limit cycles due to rounding seem to be 
caused by an effective pole at a' = +1. This observation 
leads to the assumption of an effective value linear model 


wmich forms the basis of Jackson's heuristic approach for 
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derivation of the amplitude bound for the second-order deadbands [27]. 
?, First-Order Deadbands (Case of Magnitude Truncation). 

The input-output characteristic cf the magnitude truncation 
memiinearity is drawn in Fig. 5.5. Depending on the negative number 
mepresentation used, there exist two types of truncation. Magnitude 
truncation results when a one's comolement. number representation is 
meed, it is the type of truncation considered here. 

Value truncation results when a two's comolement number 
Bepresentation is used. It is nct considered in detail because the 
Pesuits are Similar to the ones for rounding with a constant input 
added as value truncation introduces cnly a bias of 1/2q for every 
Seeeaezer. In comparison with the roundoff quantizer the characteristic 
for magnitude truncation has a deadzone av the origin, which is twice ag 
Meraree as the one for roundoff. From contol system theory, it is known 
Memeo Gcaczone Svabilizes the system resnonse, TInhuigively one would 


Beretore expect that a syste 


ta 


n with magnitude truncation is "more" stable 
Maem the corresponding system with roundoff. On the other hand, since 
Mapnaitude truncation introduces errors, which can we twice as large as 
those for roundoff, the latter seems to be preferred. 
ime first-order filter section including a magnitude truncation 
Quantizer is described by the difference equation 
“~ “~ 
mim) =a x(n-1) + 6m), Za 
where 0 < 6(n) < 1.0. It will now be proven Dymeon bradi ction. via 
no stable zero-input limit cycle can be sustained with this kind of 
p “Aw 
Meecem. To be specific, assume 0 < a < 1.0 and x(n) > 0, (the proof for 
the other possibilities follows along similar lines). Suppose a steady- 
j A “a 


state limit cycle exists. Then, from the existence condition x(n) = x(n-1)} 


mae Obtains 


7 =O(1), 


xin) =—— 
a) 1-a 


Mm 


(oe, 


it 





“ “ 


mee Oin) = O, x(n) = OQ. For 0 -<.0(a) = 92.0.5 x(n) 00 eee 

conclusion is contrary to the hypothesis made above. There- 
A ; 

fore, in steady-state x(n) = 0, which completes the proof. 


This simple demonstration has, surprisingly, not appeared in 
Mme literature. After this introductory study of the first-— 
@ecer GQigital filter let us turn our attention to the 
second-order digital filter. 

fee OORT FOR THE ZERO-INPUT SECOND-ORDER DIGITAL FILTER 

WITH QUANTIZATION 

For the study of the natural response (zero-input, ini- 
meal conditions only) of the second-order digital filter 
section a configuration with two poites and no zeros is 
desirable to avoid the Gistracting influence of the zeros 
on the response. A survey of the second-order filter con- 
Seeeemrcions from Chapter IJ shows that the only possible 
Samonical configuration of this kind is the one depicted in 
mea. 3.4, That this assumption is not ee restrictive will 
be shown in Chapter V. 

The twe quantization nonlinearities O71 and Qo, each ccn- 
nected with one of the two multipliers in the feedback eee, 
mee included in Fig. 3.4. The fact that there are two non- 
linearities in the loop complicates the analysis of the 
met Cycle response considerably. The system of Fig. 3.4 


is described by the difference equation (where u(n) = 0) 


ee a See ai 
Bet ) lane (i II, ieee) 2) Ia Coe) 


where E--1, denotes quantization cf products, either 


Meeeeugn roundoff (q = r) or truncation (q = t). 


yo 








T£ roundoff quantization is considered, the block dia- 
Meeem Of Fig. 3.4 can be rearranged into a form which is 
meecea in the later sections of this chapter. Separating 
meer roundoff quantization nonlinearity into a linear char- 
acteristic and a new, sawtooth-shaped nonlinearity as de- 
meeted in Fig. 3.6 allows one to perform a block diagram 
Manipulation which results in the diagram shown in Fig. 3.5. 
The error sequences due to roundoff are designated by oa 
and ES and can be viewed as input to the digital filter. 

See DOUNDS ON THE AMPLITUDE OF LIMIT CYCLE OSCILLATIONS IN 

SECOND~-ORDER DIGITAL FILTERS (CASE OF ROUNDOFF) 

ieeehis section three different kinds of amplitude 
fers LOK the limit cycles of the system described by (3.13) 
are presented. Their deriwation is hased on 


meee the use of Lyapunov functions to estimate the region 
Memooundedaness of the natural response of (3.13), 


Pyeeethe use of a special technique assuming that a limit 
eycle of period qT exists, and 


eye the application of an effective value linear model. 

i fn Amplitude Bound Using Lyapunov's Direct Method 

For roundoff after multiplications the difference 
equation (3.13) has to be rewritten as 


w~ 


Pn) = ~a x(n-l) + [0.5 - é(n-1)] 


ee) ee Nee (3.14) 


where O(n) is any number such that 0 < |[&(n) | Si 0m fire 
roundoff noise sequences ee fo.5 - 6(n-1)] and 


en me —6 (n-2)]} can be considered as driving functigme to 


12 





Phe difference equation (3.14) as indicated in the block 
Begcam Of Fig. 3652 Then, Lf etn isceietncee peanpu bse 
noted by u(n), one finds that |u(n)| < 1.0, because 

fee | 60.5 ~ §(n-1)j] + [0.5 = 6im-1)]. Rewriting (3.14) 
in state form, using state variables 


nN 


x, (n) = ee 


x(n-l), 


I 


x, (n) 


mame obtains from (3.14) 


(noe (3.459) 





ay 
TAN sara l(Iv1I Y etata VAChaw = ton ia 
aw ee er Lm eg — we —~— — ae et - aa us 


<> 


Note HAnt «er fn na {fn \ +n 
at eer wed REA ah Ke 6 ao wet ‘ a 


~~ 
ae —— 


(2 
,\~ 


{J 


poe b < 1.0, the magnitude of the eigenvalues of the corres- 
ponding linear system is less than 1.0 and the homogeneous 
system is asymptotically stabie in the large (ASIL). In 
eeeeron, the input u(n) of (3.15) is bounded for all n> 0. 
Therefore the theorem given in Appendix A is applicable. | 
mieorem: For the system (eT = A ap + By sae 

if the homogeneous system is ASIL and has a 

Lyapunov function V = x ox with V = ~xtox and 


Ju(n)| < k, for all n > 0, then the system is 


li 


stable and the states are certain to enter a 


Legion Cesim@ed, Dy [|< | < r5, where 
f eden | i ee ee 
cy = ky) Rmextor .| tavonl jy Iatonll , os | 
Z Ly A min (Q) Re CC ) ee ee min(Cy | 
{ pA 17 oc) 


30 








Meentify the terms of the theorem as follows: 


k, = 1.0, because ju(n)| < 1.0, 


A min/max (Q) min/max. eicenvalue of the matrix 9, 
defined by the Lyapunov function 
v =x'ox, (Sass) 


A min(C) = min.eigenvalue of the matrix C, de- 


fined to be any real, symmetric and positive 


definite matrix such that -C = A'Qa-o, (S229 
l x | = norm of the state vector x, defined as 
max |x. ! (cro) 


aT onl - WOMILOn Cae Mathis proguce Ao, defined 


as max ) a.. where a,. are the elements Of A Gbmice2 i) 
i ; 1j Lj 


meee the choice for C is arbitrary as long as C is real, 


Symmetric and position definite, let us choose for simpli- 


ety 
1 0 
a = (3222) 
0 1 
Mow (3.19) is written as 
1 0 0 el Slag) an 0 1 ae Sa 
0 1 ea Ce cn Toy 422 
ee ee 
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To solve for the elements ais of the matrix 92, the following 


four equations result: 


ee ao > Gane 7 (3 .23b) 
0 = ab Goo 7 bg54 - Ayo: | Ce ey 
0 = ab Goo 7 bd15 — Goy: (295 728161) 
-l = 4417 8. 7 ato + (are ee (3.23e) 


M@e@mations (3.23c) and (3,.23d) show that 


= . a 
pio ~~ oa feo 


The remaining solutions for Gir Ayo: and Io Ln termsiee & 


@a@andb are 


2 
M17 L + ee eae (3. 25ar 
ele een all 

- 7 2ab aes 

ee (3..25b' 
(1l-b) { (1l+b)"-a™ J 

: 2 (1+b) 

ee (e.25c) 


Geb) | Cras") 


Note that Q is real, symmetric and positive define as re- 


Guired, if and only if 


(l+b) > [al . (3.26) 
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This is just another way to state the range of values for 
the coefficients a and b for which the homogeneous system 
(3-14) or (3.15)is ASIL. 


To evaluate the bound (3.17) define 
i tatoos = max (Iba, | : G4 5-8955|). (3227) 


and evaluate 
Memin (c) = 1, and (3.28a) 


T 


plop = 422° (3 20)) 


Then from definition (3.20) the upper bcund on the amplitude 


@eethne limit cycles for (3.14) can be written as 


is San “areca 
een] <YRBBGY we 4 Yu? # ayy). (3.29) 


The bound (3.29) is pessimistic as can be seen from 
the numerical values presented in Chapter IV. This may 
meen trom the fact that the choice of the matrix C and thus 
Q is arbitrary and therefore it is not guaranteed that the 
"best" upper bound has been found. The latter is a weil 
establishec disadvantage of Lyapunov's direct method. How- 
ever the bound is er ved without any specific assumption 


about the roundoff sequences Ee and’ ¢€ except for the fact 


b! 
Beate they are bounded. 

It is now shown that limit cycles always exist if 
meunaort quantization is employed and the filter coefficient 


b has values such that b > 0.5. Previously it has been 


eown that the system (3.14) is stable. Let us now #£AGw by 





Mentradiction that the zero-state cannot be reached for any 
(n—-1) greater than some value N, if b > 0.5. Suppose the 
Mmeeo-state is reached and maintained for some (n-l) > N. 
mhen x(n) = x (=)) = 0 and Ix (n-2) | ee SUS EEUU bia 


this into the difference equation (3.14) one obtains 
beain=2)= £[0.5 — 6 (n-2)].- (O20) 


Since lbx (n-2) | >0.5 by hypothesis and ]0.5 - 6(n-2)| < 0.5, 
Meno0) Cannot be satisfied. This is contrary to the hypc- 
tnesis. 

Mempeollows that the zero-state Cannot be reached for 
mee 0.5 and the system 1s marginally stable. Thus, limit 
Syeres always exist if roundoff is employed and 0.5 < b< 1.0, 
MMe is equivalont te stating that the poles of the z-trans- 
formed equivalent of (3.14), are inside an annular region 
in the z-plane defined as JB < te dO ere Yr is the magni- 
tude of the poles. This conclusion has been reached hefore 
Dy Jackson [27], however without the exact proof as out- 
lined in the above paragraph. 

4. A General Expression for Zero-~Input Limit Cycles. 

The periodicity of the limit cycle oscillations can 

be used to develop a general expression for the limit cycles 
Maematrix form. Let us assume, that a limit cycle of period 


Beeeecxists. From the definition of a limit cycle and its 


Pemtodicity it follows that 
x(n) = x(n-q), 


x(n-1) = x(n-q-l), ( 
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mma sO On. 


(3.14) as 


e 


He 


gO aii at) | ee ome ede) ale 


Let us redefine the roundoff sequences from 


(32-35) 


Then, from the difference equation (3.14) a set of equations 


mem be writz~en as 


sn 


nw 


paca) + a x(n-l) + b x(n-2) = Eqs 
x(n-1) + a x(n-2) + b x(n-3) = € 


nw 


ns 
Peini—Gti) + a 


pee Ot 2) + a X{nieo—-)) tb x (n-c) 


Substituting 


Meaing matrix 


1 


0 


a 


1 


oe 


“aw 


II 
m 


> 


wn 


CpSteO| Se) lo) xe intel), 


I 
m 


rs 


(sae 0)eiuto, thescystem Of Equealenom(s 3 2)mounc 


mMetatioOn One Obeains 


by 0250 OOO Scie) 

a b QO OO ee 
cra? Coa Oo ee) 

OF 30: © 1 aeob nas 
OF 220) FO meer Oe eect Nneeeon 
Cro Oo 0 OO Ll ince) 


mM 
a 


m 


UJ 





Meeshorter notation (3.33) is rewritten to yield 


“A 


AX = ¢€, 3259 4) 
where A is a square matrix of dimension gq x gq and : and ¢€ 
are the vectors constituted by the limit cycle points and 
the roundoff error sequence respectively. 

Pema spec lalecace,  £O Simei / ene vag eo avolvee, 
consider a symmetric limit cycle whose samples in the first 
half-period are equal in magnitude but opposite in sign to 


the samples in the second half-period. This type of limit 


cycle can he described by 


“A 


(x), Xo seer Saye Hag /2! ae a where 


aw “A 
xX, = = X, 
Jk 


tq /2! (35 350) 


“Aw nw 
=- — xX 


Ba/2 q 


Thus, gq has to be an even number. 
Mne set of Eqs. (3.33) or (3.34) can be partitioned as 


moe. lows: 
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S/ 
aa 1 a eee ia 
“tq /2 


© 24+¢q/2 





a 

in = (roy) 
C B —~X 5 
= 


From above it is deduced that Ey = “E. - Furthermore, in- 
stead of solving the system of q equations, it is only 
necessary to solve the set of g/2 equations. 


Imastead of (3.34) one now solves 


[B-Cc]) xX = FE where (oe) 


ee 
Meeo! is a square matrix of dimension (q/2 by q/2). Note 
Meat there is a difference between the matrix A for a limit 
Sycle of lencth a = m and the submatrix [B-C] for a =Vlanietric 
meee Cycle of length a = 2m, in that the signs of the 
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three elements in the lower left hand corner of [B-C] are 
mae negative of the terms in the lower left hand corner of 
A. 

Fron the initial assumption, that a limit cycle 
(not necessarily symmetric) of length aT exists, it follows 
that A has to be nonsingular, if and only if at least one 
Es * 0. Furthermore, A has to be singular, if and only if 
all a 0. The latter condition signifies those values of 
the coefficients a and b for which a linear response {no 
roundoff quantization) is possible, whose samples in the 
meerod Of oscillation are all integers. x is easy to see 
that this requires that b = 1 and therefore A cannot be 
Meoular for b < 1.0. 

From (385 it 1s seen that fof rvounduril quanti- 
zation 0 ae. < 1.0, and eee that noe aii e = 0; 
Seoound for the nas) can be found by solving (3.34) using 
one of the many methods of solution available. 

Using Cramer's rule a solution for x (ped) is found 
feom (3.34) as 


| (column 1) 
E 
€ 
E 











lea Oia 0 
Owe) ; 0 
c= 1) = ae < 0-2 0 aa 
me 0 cel 
ja b > — 
q ~ 
— eee aoe : 2 oe - i “Oi ee i 2 ca (a ; 
aqet A = 
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The expressions det ont GeNnOLe Ene vecoractoucson ae Elia tas 


. ; Foxit ile 

the determinant with Sign (i + of the matrix formed by 
Hes ae 

deleting the row and column of A which.-both contain €.. 


Using the bound on Est (3.39) is rewritten to yield a bound 
B 0 
ma |x(n-i)|. 


le, det A 4, +..-4 ae det A 


[det Al 


“a ; | 
|x(n-i)| = aS 


q 
} |det A, | 
< Be ee tel a. (3.40) 
|det A | 

Mme to the cyclical nature of the equations (3.33), it is 
possible to show that the bound from (3.40) has the same 
numerical wabue for aliea = 0, 1, 2, «8.7 /0=) and is thus 
the only bound for the samples contained in the assumed 
emit cycle. 


To show this, it is noted that for every square 


matrix A with elements as 


i 
det A=) +[a a a SAid: ae. ae 
: ; lpl “2p, “3p, oer i See4 as) 
The sum is extended over all permutations p = q! of the 
Micegers 1, 2, 3, ...-, q and where a + or =— sign is affixed 


to each product according to whether ois an even or an 
odd permutation. In the expression (3.41) the indices 


Py {P5P3 --- el are the permutations Cue elke ec ieics 


2 q. 


See for example Ayres [33], p.20. 


eg 





”~ 


Consider mow (3.39) for thems values cf Janae 


Mhe matrix A is used to form q new matrices a by replacing 


ehe 2 


column of A with the column vector ¢. Those mat- 
rices are then used to compute the cofactors of =. and are 


of the form 


As. = qos row 


deleted 


‘ (3.42) 





Regardless of which row and column are deleted the matrix 


A will contain the same elements 0, 1, a, b which make up 


aL 
the products in (3.41). Since sign-changes are of no con- 


cern the summations 


y |det A... | 
i a 


Meeeeagual for all i= 0, l, 2, ..., q-l and the bound (3.40) 
has the same value regardless of i. Thus the bound on the 
amplitude of a limit cycle with period qT is given by 
q . 
y |det A..| 
aa 


. al 
a ee (Jee 
hy dec 4 
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mete that this bound is different than the Lyapunov pound, 
because the period of the limit cycle qt has to be specified. 
Mme Svaluation of (3.43) gets rather complicated for large 
g, even if the assumption of symmetry in the limit cycle 

can De made. Some simple, but important examples will serve 
Bem lustrate the use of the developed bound. For gq= 1, 


one obtains by inspection 








“a & 
_ oe a8 
mi) > Ttarb < Itatb oan? 
Bemeg = 2, (3.33) can be. written as 
(1+b) ~ a x (n) - 
== : (37450) 
, a Te | zane a 


rt follows that 


rR €e (i+tb) - ae 
cain) = See ae and 
1+2b+b -a 





x(a le eee ace ee : (3.45b) 


~ |l+atb| |[1-a+b] | 1l-atb| 


Mme cases q = l, 2 correspond to limit cycles with frequency 


== 0, : Eos From the knowledge about the signs of a and 
Meet ne expressions (3.44) and (3.45) can be combined to 


yield 


Rice (3.46) 
~ 1-|al+b 


The bound (3.46) has been reported by Jackson {27] au 


ol 





and Bonzanigo [28} before, nowever not as the result of a 
Meneral derivation as presented here. For gq = 4, (3.33) 


can be written as 


ae 


eo. A 
pee a wD. 20 aro) | e 
Oo 
Ome de Beeb x (n-L) eT 
eo va (tee 2) eae ey 
amet 70 1 | x (n-3) E4 
meecrollows that 
x e, (Lta“b-b*) ~c, (atab*) 4- Ee. (a-btb”) ~,, (a°-2ab) 
7 ae 
_ te ao eee tio 
(37747 on 
moe a= 0, one gets 


uae 2. 
x (n) ae ee a (3245) 


\1-2b*+b "| 1-b 


The bound (3.48) is larger than what it should be by a 
Factor of 2, because it is assumed that le. | <0; How- 
ever when a = 0, le. | << 0R St 

Another mechod Oi, SOLUCION fon (2.23) "Ss ) baccemen 
the use of a flow graph and application of Mason's gain 
meee. Since the flow graph demonstrates the continued de- 
pendence of each limit cycle point on the previous limit 
eyere points and the roundoff samples, the flow graph repre- 
@emting (3.33) is included in this chapter as an interesting 
Beepnical representation of the generation of limit «rles. 


The flow graph is shown in Fig. 3.7. 


— 


oe 





The importance of the derived bound (3.43) lies in 
fhe fact that this is an absolute bound. However, the 
bound is not easy to compute. Numerical values for some 
mepresentative values of a, b, and qy are presented and 
compared with the other bounds in Chapter IV. 

fence Bifective Value Linear Model. 

Consider the system depicted in Fig. 3.4 without 
the quantizers in the feedback loop. The transfer function 
of this linear system is 


2 
2) = ay (3.49) 
Zz +az+b 


From Chapter II, we know that stability (ASIL) is 


j 


- 


essured, if and only if Q< b < 1.0. The case of b = 1.6 


e 


describes a digital oscillator and is the limiting case 
between stable ana unstable response. 

For the nonlinear system (roundoff quantization 
macluded) Jackson [27] postulated that limit cycles occur 
(the system is marginally stable) if, in effect, b = 1.0. 


Mefine an effective value for b as b' using the difference 


Meeeoeron (3.14), which is repeated here for convenience: 


Ge 


~[ax(n-1)], - [bx (n-2) 1, (3.50a) 


Pn) ~[ax(n-1)} - ee (3.50b) 


meen, by equating (3.50a) and (3.50b), one gets 


[bx (n-2)], = bx (n=2)2 [0.5-5 (n-2)] = btx(n=2). (358 





Bee sutficient, but not necessary, condition for a limit 
Meere response is, according to Jackson, that b' = 1. 
Roundoff effectively moves the poles of the digital filter 
Gescribed by (3.50a) from inside the unit-circle in the 


Z plane onto the unit~-circle. 


few — |, them from (3.51) 
A +. [Oa ~~ _ 
x(n-2) = #10.5 - 6 -2)) - (3.5592) 





dels 


Since x(n-2) is equal to x(n) delayed by two time-units T 


nw 


and 10.5 = 6 ‘n-2) | Ss ne boGndmone s(n} 1S deceisbocd 
by 

; 0.5 

[x (n) | ea ° (3535 


The consequences of the postulate are now demon- 
Pieeated with the example of a digital filter with a = -1.9, 
b = 0.9474 and ei Condi trons (0, 3)2 the lame severe 
Besponse is computed from (3.50). In addition, the values 
Zor C and €) are displayed in Fig. 3.8. The bounced nature 


of e4 and Ey lo wCOrRLelOLatea by fi gas 25. 
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computed 

n x (n) 

T e 

2 = 

5 e. 7—0 

4 Hee, 4-2 .8442 
> io. 2-5.6844 
6 eet 7.5792 
| mot -3 .5266 
8 for, 2-3 .5266 
2 mee) 5/92 
10 Mi? 2.0844 
ml we2.0422 
a2 mo. / —0 


ma SO On. 


The missing samples of the 
Bemis are equal to the negative of 


9. An inspection of the term «e 


rounded 


x ( 


n) 


Ia@uinG@@sed: ac FOunC em: EL 


a 
am one, “A ae 
) . fioml bx cm ay), 


| a | 


A 
fFrom[ax (n-]. 


oo 0 
=r -Q.2573 
Ole OMS oo 
= 0:22. -0.4298 
=a: -0.4734 
age -0.4734 
-0 .4 -0.4208 
Ver =r eG 

0 =) oie 
“0:33 0 

jamie cycle tery ne=all. 
the samples for n = 4 to 


b reveals that 


)| = (l-b) x(n-2),.which is equivalent to the statement 


meeve, that b' 


= 1. 


Returning to (3.53) and noting that the smallest 


amplitude for a limit cycle is unity, it seems reasonable 


mat no limit cycles are possible if b < 0.5. 


This state- 


ment about the existence of limit cycles has been proven 


Magorousiy, without recourse to an effective value linear imedel 


2N paragraph D.1. 


The boung 


-53) is easily appliceh 





However, since it is based on the assumption that the non- 
Jinear system oscillates if b' = 1 (which is a carry-over 
from linear theory), there exist exceptions from the bound 
(3.53). Consider another numerical exampie for a = -1.6, 


fe) ,9474 and initial conditions (3,9). 


computed rounded 

n = (n) x(n) E5 Ep 

iE - 3 - — 

2. - 9 - - 

5 14.4- 2.8422 f4—5 = 21 -0.4 -~0.1578 
4 ime co - 8.5266 iso = 9 On -0.4734 
5 M4. 4-10.4214 14-10= 4 -0.4 0.42714 
6 oe4— 3.52606 6-9 =- 3 =O, 4 -0.4734 
fee O- 3.7896 —- 5-4 =- & Ue -9 2104 
Be -14.4+ 2.8422 -14+3 =-l1l 0. 4- Ue wove 
9 -17.6+ 8.5266 -18+9 =- 9 -0.4 0.4734 
Mee —14.44+10.4214 -14+10=- 4 O. 4 -0.4214 
Mme 6.4+ 8.5266 - 649 = 3 0.4 0.4734 
eZ 4.8+ 3.7896 5+4 = 9 G.. 2 0.2104 
3 imea—= 2.8422 14-3 = ll -0.4 =O 570 


mne values for €, are alcerdt splayed in Fig... 


fm inspection of ¢€, reveals that for n = 3, 4, 6, 7, 8, 9, 


b 
meet 2, it is still true that |e, | = (l-b) x(n-2). However, 
fee = 5, 10,a discontinuous jump occurs and for this rea- 


son the effective value linear model is not valid any lonocr. 


Bormerhne "exceptional cless of Jinit cycle res are 


= 
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a new bound is now developed. If a discontinuous jump of 


om € Valve occurs, then 








b 
es (l-b) x(n-2) -l. | (S254) 
Because x(n--2) 1s a delayed version of x(n) and ED | ee 
(3.54) can be used to evaluate a bound, such that 
“ 5 
Ix(m)| < Fp (3.55) 


Experimental data (see Chapter IV and Appendix B) indicates 
that there exist limit cycles whose amplitudes deviate from 
the bound (3.53) (but always remain inside the bound (3.55)) 
as much as 6 quantization Stepes 1 Z2ZeGusdave. peo Um es ):, 
Clearly then, the bound (3.53) derived from the effective 
Vaiue ianear mocel is only a rule-of-thumb. The preceding 
example and the existence of the bound (3755) 92s alserecen- 
trary to a statement made by Jackson [2], that “some of the 
observed limit cycles for b > 0.9 have exceeded the limits 
Seeeas given in Gane by =! (Gee. pe ey One quanti zav1ei sce er 
but never more." | 
The avec HeenUmes tea hidaromiMeleates tial exces 
tions from the effective value linear model occur for 
b = = ies. ancora valwes Of samanound 21..5 mt emeesO com 
mB. AN APPROXIMATE EXPRESSION FOR THE FREQUENCY OF LIMIT 
CYCLE OSCILLATIONS (CASE OF ROUNDOFF) 


mre limit cycle ovwtput of any quantized second-order 


IL é . r “~ 
maemson ' Ss Formula (6.4) correspcnds to (3.53) 


oi 








System is periodic. The condition for periodicity is given 


as 
ram) x(n=q), Lorcaldeag = 717273 oe (aay) 


The period of the limit cycle qT must contain an even num- 
ber of Sign--changes between successive samples. Because of 
Mueeeocrete nature of the response with equally spaced 
samples the number of sign-changes per Jimit cycle period 
qT is adopted to define the frequency Es ofea limite yelc 
Meeeonse. Let the number of sign-changes per limit cycle 
period be 2. There are two sign-changes per individual 


oscillation, therefore frequency is defined here as 


=e . _P 5 
mence f == iL one gets 

5 He g 

fs D 

F = 5 . C35) 


The limiting case where all limit cycle points have equal 
Meee 1S defined with p = 0 and g = 1, such that the fre- 


ma@ency of the constant case is 


Kh 


O _ 
_* Oe Gxeve) 


The other limiting case occurs at the Nyquist-frequency, 
where the samples change.sign after every sampie (p = 1) and 
vay s 


the limit cycle repeats itself after two samples (q = 2}. 


Por this case, the frequency is given by 





Fh 
lo 
Nb 


(oe) 


Ky 
wu 


Seem the Limiting case (3.57c) and (3.57d), it is concluded 
ile 
tee D> < Gg, and since p and q are integers, ews always a 


= 
Mmeeronal fraction. : 

Inspection of experimental data shows that the frequency 
@emoeoaghiy nonlinear function of the filter coefficients 
aand b and the amplitude of the particular limit cycle. 
meyer Or a few exceptional values of the coefficient a can 


the frequency a be determined analytically. Among these 


fee the cases, where a = -1, 0, +1. The frequencies fe 


zespectively. 


Lo] 


a | 
ana 


yr! 
a] 


for these are =, 
in Chapter II, the expression for the frequency of the 
Meear digital filter is stated. Using this expression, an 


approximate expression for the frequency of the nonlinear 


System is at hand. This approximation is given by 


de 
= = == COS + ( oie ) (S250) 
S DN: 

Bey, tL the effective value of b' = 1 is substituted for b, 
then 

E 

oe “=. a 

a eee Ue (2260) 


Mew well (3.59) describes the actual frequency of the lirit 
I y 


ro 7 Lf 


Bycles is displayed in Fig. 3.10-12 for values of b 


2 





0.75 and 0.&6 respectively. AS can De seen from the graphs 
mee approximation gets better for higher-Q filter sections, 
Mee, tor b close to 1.0. However, it should be noted 

(see for exampie Fig. 3.12, a = + 0.3) that for many values 
fa two or more oscillation frequencies may exist, depend- 
Meaeon the particular set of initial conditions used. This 
is not surprising for nonlinear systems. 

eee eo —-PLANE PLOTS OF LIMIT CYCLES AND SOME OF THEIR 

SeemETRY PROPERTIES 

Meerec-Plane plots are a useful technique for the graphi- 
cal analysis of second-order differential equations. For 
the study of seiieenee equations a similar technique is 
developed here. A special plot (herein referred to as the 
succesSive value plase-planc plot) resuits if successive 
Mmeaces Of a second-order discrete system are recorded cn a 
cartesian plane with axis x(n) and x(n-1). In the usual 
phase plane x is plotted versus x with time as a parameter. 
The natural extension of this to discrete time would be to 
plot the first forward difference Ax(n) = x(n) - ea 
versus x(n), but experience has shown that meaningful re- 
sults for the digital filter are obtained only if x(n) and 
x(n-1) are plotted instead. 

It is generally not too useful to employ the successive 
value phase-plane with axis x(n) ae x(n-1) for the analysis 
of quantized second-order systems because the existence of 
two nonlinearities complicates the graphical analysis. How- 


Mee, it 1S instructive to display the limit cycle Gesvonses 
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menpexnhibit their characteristic features graphically. The 
results of this analysis are presented in Chapter IV for 
comparison purposes. In this section some new results are 
introduced concerning the symmetry of limit cycles. It is 
shown that the successive value phase-plane plots for two 
Pyetems with parameters a and -a are identical except for a 
Bhange of orientation of a symmetric axis. The latter con- 
S'igsion is also important, because it asserts that any bound 
on the magnitude of a limit cycle response evaluated with 
the assumption that a < 0, b > 0 is equally valid for 

meg, b > 0. From experimental data it is known that three 
types of limit cycles exist. They are classified as: 

a) Type A: The limit cycle has half-wave symmetry, i.e., 


half-waves equal each other in magnitude and differ in size. 


Two samples per cycle are zero.. This response is described 

by 

me.) ,..., X(i-1), x1), x(itl),..., x(2i-1), x(2i)], 
(oot. 6 1) 

where mat) = x(i4+1) = 0, and 


x(k) = -x(itk), for k = 1,2,..., i. 
b) Type B: The limit cycle has half-wave symmetry, however 
no zero-samples exist. The response is described by (3.61), 


except that. 
pen) = “x{iri) - 0. 


©) Type C: The limit cycle is unsymmetrical. This response 


is described by 


re™~ 
CA) 
S 
ian 


Pie eee Ge ee te 


where gq is always odd. 
On 





Three lemmas are now presented about the three types of 
mat cycles. 
Lemma 1: Given a digital filter with roundoff quantization 


ama. a Gefining equation 
Pn) = =a x(n-1)]) aa x(n-2)]_. (oo) 


Assume that the digital filter has a limit cycle 
response of type A. If the sign of the filter 
parameter a is changed then two new limit cycles 
are possible, where the two new limit cycles 
equal either half-cycle of the original limit 
cycle in magnitude, but differ in sign after every 
second sample. 
Broo : EMepose 4a tamit Cycwe @& type A cyvcte. This 7e> 
Sponse is described by (3.61). Let the sign of the coef- 
ficient a be changed and evaluate the filter response for 
Mattial conditions a = con 7 On = ~¥ (2). PEeme uae 


difference equation above, one obtains successively 


y(3) = -[(-a) -x(2))1, - fb x(1)) = x03), (3.64) 
y(4) = -[(-a) (x (3), - [b(-x(2))]} = -x(4), (3.65) 


and so on. Thus a new sequence of samples result which has 


the form 
Me (2), x(3), -x(4),..., xCi-1), -x(i), x(G41),.-. 
eee eae. (3.66) 


Furthermore for type A limit cycles i is an even nun. .ir ana 


Oe 





“A 
mre sign of x(i) is changed, as are all other samples with 
Men indices. From the conditions stated by (3.61) it is 
seen that the sequence (3.66) consists of two repetitions of 


the one new limit cycle 


ene Oe chee ee (Ce ne CrE: 


meng the same procedure as above for the initial condition 
f-x(1), x(2)] another new Limit cycle is obtained which has 


the form 


ere Oe) (ee = GL Gan 


meesnould be noted that the initial conditions ee Cie x (2)] 

and [=x (1), = dead in general to completely new limit 

cycles which bear no resemblance with the sequences given by 

Memeet (3.61) or (3.6077 and (3.58). 

Meee: «€©6Given the same system as for lemma 1, let the 
Gicitalmert itemmiave a tesponse of toe Bo wei eene 
sign of the filter parameter a is changed, then a 
new limit cycle is possible, where the new linit 
eycle eCuale ENeueriginal one in Magnitude, bur 
differs in sign after every second sample. 

BEOot : The proof for lemma 2 is identical oO Ehe proot 

for lemma 1, except that only one new limit cycle of the 

merm (3.66) results, because both initial conditions 

[x(1), i) and oe 2 (2)] lead to the same result. 

Lemma 3: Given the same system as for lemma 1. Let the 
digital filter have two responses of type C, Witerc 


the one is the sign~-inverted version of 


O03 





Tf the sign of the filter parameter a is changed, 
then one new limit cycle is possible, where either 
iene Sete os the new Limit cycle sequence equals 
either of the two original limit cycles in magni- 
ude, but differs in sign after every second sampie. 
Broof: [The two limit cycles of type C are gavenm by (3762 
The first limit cycle and its sign-inverted version are con- 


catenated to yield 


Pie eh eial. Sale = Oe eae 


EOS!) 
meplying initial conditions y(1) = x(1) and y(2) = -x(2) to 
Mme difference equation one obtains successively 

y(3) = -[(-a)-(-x (2), -[b x(2)1, = xG), (3.70) 
y(4) = -[(-a)*x 30], -ibx(2))1,= -x4), (3.71) 


maa SO on. 


pamce gq is odd one gets 


y(qtl) = -[(-a)x(q)], ~fb(-x(q-1))},= -x(), (3.72) 


ee a eae oh) | a leeea (a i — x (2), (G72) 
and so on. 
A new sequence of samples results which has the form 


a es Cheney). hae 


fs 1S the new limit cycle. Application of the initial con- 
ditions -x(1) and x(2) yields the same result as above. 
The conclusions of the three lemmas are demonstrated with 


the following examples: 
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10 


I 


2 


The limit cycle sequence of type A for a =~1.8, 
ee04/4 results in two new limit cycles. tor a — 1.8, 


we474 of type C as Stated im the following table: 


x(n)=1.8 x(n-1l) x(n)=-1.8 x(n-1) x(n)=-1.8 %(n-1) 
~0.9474 x(n-2) -~0.9474 x(n-2) -9.474 x(n-2) 
0 0 0 
4 -4 4 
7 7 = 
9 z9 9 
9 9 Eo 
7 ; ae 7 
4 4 4 
ee a 7. |. oe a Taal 
-4 -4 4 
7 7 =F 
Bo =o 9 
~9 9 ~9 
a a7 Ai 
=f 4 4 
The limit cycle sequence of type B for a= -1.8, 


079474 results in a new limit cycle of type B for a = 1.8, 


0.9474 as given in the following table: 
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n Ser) )) = dere ale x(n) = -1.8 x(n-1) 


=O Aaa on) -0.9474 x(n-2) 
0 i} tt 
1 3 =3 
2 4 4 
3 4 =A 
4 3 3 
5 1 =) 
6 —1 = 
a 3 3 
§ ~4 ~4 
9 —4 4 
10 =3 | -3 
el a1 1 


i two limit cycle sequences of type C for a = ce 
Seo. 2484 and its sign-inverted complement result in a new 
meme cycle for a = 1.8, b = 0.9474 of type B. The original 
Ppa the new limit cycles are presented in the following 


table: 
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~N 


me x(n)=l1.8 x(n-l) 


Pee 
MF OM MOND OH ®wWDN 


a) 
OO 


5 
20 
ZL. 
22 
pe 
24 
25 
26 


-0.9474 x(n-1) 


-_— os OE = oe oe oe T= oe oe oe we ew ot ee EE EE Te Tew Cee ee eee ee 


~~ 


Sn ise een) 
“N 
-~0.9474 x(n-2) 


WO DW WO WO DD W 


x(n)=-1.8 x (n-1) 
A 
-0.9474 x(n-2) 


Many more examples of the presented three types can be con- 


Seructed from the tables of Appendix B. 


coo 





If these limit cycles are drawn on the successive value 
phase-plane as defined in the preceding paragraph, it is 
seen that the phase-plane plots are identical except for a 
change in their symmetry axis. The experimental verification of 
this is delayed until the next chapter. 

After the study of limit cycles because of roundoff 
quantization let us turn our attention to magnitude truncation quanti- 


Zaction in second-order digital filters. 


eer CYCLE OSCILLATIONS IN SECOND-ORDER SYSTEMS 
(CASE OF MAGNITUDE TRUNCATION). 


The second-order Be eeen tol be, Studied im ehisvsect ten 
Memene same as the one depicted in Fig. 3.4. However the 
_two nonlinearities in the feedback paths now have the in- 
MmeeoutDbut Characteristic cf the magnitude truncation quantizer as 
Seva in Fig. 3.3. 

As might be expected from the result of paragraph B.2, 
where it has been shown that the first-order section with masnitude 
memmcation is ASIL, little or no limit cycle oscillations 
can be observed in the second-order case. However, it can 
be demonstrated that some limit cycles exist. For initial 
Semeaitions (1, ioe re iee Limite) Cllenwa tm Ix (n) | = ] 
will always result if ja| > 1.0. 

For complex conjugate poles of the second~order system 
one predicts with the help of the effective value linear 
model that no limit cycies with frequencies rae between 
O and 1/2 are possible, because in no way can an effective 


co 


fee OL > = 1 be obtained from nagnituce tram@aclon. 7 8 BibP®one 
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Meeeeion for a zero-input digital falter with truncation 
Meegiven as 

x(n) = ~-a x(n-1) + 6(m-1) ~ b x(n-2) + 6(n-2), (3.75) 
where S(n-1) or 6(n-2) are numbers, such that 0 < |6] < 1.0. 
For the purpose of this demonstration suppose that 


Meee) > 1. Since 0 < b < 1.0 it follows that 
b x(n-2) = 6(n-2) < b x(n-2) < x(n-2). Ca 


However, this is contrary to the condition for an effective 


value of b = 1 which would require that 
*x(n-2) - §(n-2) = x (n=2). (S78 


Therefare 


i 


an effective value cf b = 1 is never possible 
meee truncation guantization. 

Meee situation is different for pole locations of the 
estective value linear model which are real. Then self- 


oscillations are possible. Consider the case where 

in) == ae) = oo Die. frequency Of this Limit cycle 
is  - i Applying the above ecendition to the adiftrerence 
ation Se 7s) requires that a< 0. Furthermore fron (3.75) 


and assuming that x(n) > 0 one obtains 


-6 (n-1) + 6 (n-2) 


Va 9 ore 


x(n) = 


Assuming that x(n) ¢ 0 yields a similar result, such that 
mee DOund can be written as 


Bol < ppars “ret 
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“& ~™ 
Mensiaer the other possible case, where x(n} = -x(n-1). 


> 


emeeaing Condition to the difference equation (3.75) re- 


The frequency of this limit cycle is e= = = Applying the 
S 


meeres that a > 0. Following the same steps as in the 


meoot above yields the bound 


wN ' iL C 
|x (n) | = eS is) e (3.80) 


Since in the first case a < 0 and in the second case a > 0, 
the expressions (3.79)and (3.80) are identical and the 
common bour.d iS given by 


i 


——_—_———_— , ee corue 
-1-|a]+ b 


Ix(n) |< 


It remains to evaluate the regions of stability for 
mee second-order digital fliter with truncation quantization. 
The smallest possible valve for a sample in the limit cycle 


is one or 

Ix(n)| > 1. (3.82) 
Using (3.81) together with (3.82), this requires that 

fe) > = oes 


For limit cycle oscillations, it is therefore simply required 


that 


la[ > 1. (3.84) 


The condition (3.84) is shown in the parameter plane o. 


fee 5.13, which depicts the regions of stable (ja; #1. 


cet) 





Mea unstable (a > 1.0) response. 

Computer simulaticn for a wide variety of a, b values 
and representative initial conditions has verified the 
above stated results. Roundoff quantization seems to be 
favored in the literature because ics GuaMiazZacLon erEors 
are smaller by a factor of two if compared with truncation. 


However, it might be advantageous to use truncation quanti- 


zation if zero-input limit cycles are a problem. 


H. SUMMARY 

The purpose of this’chapter has been to investigate 
@eee-rinput limit cycle oscillations in second-order digital 
filter sections. Sinee this response depends on the initial. 
‘conditions only, it is the natural response of these filter 
Sections. The limit cycle oscillations ave caused by 
Mmemtazation (either roundoff or truncation) of the results 
Sremultiplication of data samples with filter coefficients. 
The filter sections are assumed to be realized with finite 
precision, fixed-point arithmetic. the Geterministic analy- 
meewot the limit cycles is complicated by the fact that 
there are two quantizer nonlinearities in the filter struc- 
fee. §«=6Since the limit cycles are mostly unwanted noise, 
it is important for the engineering design of digital fil- 
ters to provide expressions about bounds on the amplitude 
meer requency of these limit cycles. 

After description of the nonlinearities and the filter 
models used in this chapter, several new results about 


limit cycles were presented. It was shown that a gygonrcvra 


ie: 





expression for the generated limit cycles is 


~~ 


ae (3:26.55) 


a 


where x 1S a column vector whose q mlements are the limit 
cycle points, € is the vector representing the roundoff 
noise sequence and Ais aq x q matrix. This equation was 
used to derive an absolute bound for the amplitude of the 
limit cycle. Employing Lyapunov functions, another abso- 
lute bound on the amplitude was derived. Both bounds are 
conservative. However, they are absolute bounds, which is 
miecontrast to the bound derived for the effective value 
linear model. 7 

For complex conjugate poles of the filter transfer 
Memccion Jackson {27] has shown that the sufficient condi- 
tion from the effective value linear model yields an ampli- 


tude bound, which is given by 


Ome 
tea 





Peay |< (3.86) 


mes bound is a function of the filter coefficient b only 
and therefore much easier to apply than the previously 
presented amplitude bounds. However, it was demonstrated 
baat this bound can be exceeded by several quantization units. 
The bound should therefore be applied with care. The de- 
rived different bounds are evaluated for representative 
Pemmes of the filter coefficients a and b in the next chap- 
fee =A detailed comparison of the three bounds is therefore 
Metayed until the next chapter. 


As a new result, some lemmas about symmetry prec 


ee 





of state trajectories in a specially defined successive 
value phase-plane were introduced. The results are impor- 
tant because they show that any amplitude bound evaluated 
@eeescpecified filter coefficients a and b is equally valid 
for -a and b. 
Finally, it was shown that magnitude truncation quantization can- 


Mot Sustain a zero-input limit cycle with intermediate fre- 


£ i 
quencies = such that 0 < = < a However zero-input 
S Su 
limit cycles with frequencies = Ovens = are possible. 
Ss 


Since it is only possible to state an approximate ex- 
Pression for the frequency of the limit cycles, an impor- 
meme problem remains still open for further research. 
Meumeency 1S a complicated function of the filter coeffi- 
Sment and the amolitude of the particular limit cycle. It 
would be useful to, at least, formulate some bounding 
mepressions in order to be able to ee Ene GGvViatlonucue. 
Sie limit cycle frequency from the natural frequency of the 


Berresponding linear filter. 
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iV. PRESENTATION OF (EXPERIMENT eboek Sins 


fee) CL NTRODUCTION 

The analytical results derived ir the preceding chapters 
are now tested and compared. For this purpose three computer 
programs have been developed. These programs are written in 
PL/1 and FORTRAN IV and have been run on the IBM 360/67 of the 
meer. Church Computer Center of the Naval Postgraduate School. 

The first program is an analysis program for zero-input 
timit cycles in second-order digital filters employing round- 
meeeequantization. Given a particular choice for the filter 
Seerficients a and b, all possible limit cycles within a speci- 
fied area of search are evaluated and displayed in a successive 
Walue phase-vlane nlot. The important feature of this pro- 
gram is that. all possible limit cycles are enumerated by 
solving the filter response for all reasonable choices of 
m@ptial conditions. With the numerical values for the limit 
cycles avaiiable, it is then possible to compare the actual 
amplitude of the limit cycle with the predicted amplitude, 
Beeaimed from the derived bounds. Furthermore, from the re- 
sulting successive value phase-plane plots, -t Came be dea 
ced how closely the limit cycle trajectory fits the elliptical 
Peayectory expected for a nearly sinusoidal response. 

The second program implements two of the five amplitude 
bounds derived in Chapter III, such that a comparison between 
the different bounds on the basis of numerical results is 
possibie. The five bounds compared in this section are re- 


peated from Chapter III and summarized in the following tabic. 
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The bound (4.1) is shown to be the most pessimistic one. 
For values of ja|, such thatlaj approaches (l+b), it is 
shown that the bound (4.1) gets so pessimistic that it is 
useless for practical applications. The bound (4.2) has the 
complication that the period gT of the limit cycle has to be 
specified as an additional auieaee ees: 

The bounds (4.3) and (4.4) are not exact, because they 
are based on the assumption of an effective value linear 
model. However the numerical data indicates that (4.3) is 
exceeded only in some exceptional céses. For those cases the 
bound (4.4) is valid. A comparison between the actual limit 
cycle amplitudes and the numbers obtained from (4.4) shows 
that the bound (4.4) is never exceeced. However its deri- 
Vation is not exact and an exception of (4.4) may exist. 

The bound (4.5) is again an exact bound. It applies 
to limit cycles with zero-frequency and with the Nyquist 
frequency (£ /E = 5 Say 

The third program is a simulation of an important special 
Case, the digital osciliator, as first considered in example 
Meet section II.D. The difference equation for this kind of 


digital oscillater is given by 

“A A “A 

x(n} = -[a x{n-1)}, - x(n-2). (4.6) 
The nonlinear Eqn. (4.6) is linearized by assuming that 


ie x(n-1)) , = ei . (4.7a) 


and 


LZ 





The Beeeciesent a' is approximately constant if e€ approaches 
Zero. This is the case if x(n-1) is made larger and the 
@uantization step-size is constant or if the quantization 
step-size 15 made smaller and % (aod 1s kept below a speci- 


fied constant. Equation (4.6) is rewritten as 


x(n) = -a'x(n-1) - x(n-2). (4.8) 
Equation (4.8) is the linearized version of (4.6). Its poles 


are located on the unit-circle in the z-plane, as given by 


the characteristic equation 


2° eee late ete) (4.93 


meen (4.9) it is deduced that (4.6) indeed describes an 


@eca!tator 


m 66 * a 


As a new result bounds on the frequency of the digital 
Mme iiator are derived from (4.7b). The result is not exact, 
however a comparison between the observed frequencies of the 
fame cycle oscillations and the computed values for the 
bounds indicates that the bounds are not exceeded for those 
examples considered in this section. 

Mes a given initial condition, the response of the oscil- 
lator defined by (4.6) (either with magnitude truncation or with round- 
off quantization) is compared with the response expected 
from an infinite precision linear oscillator. The compari- 
son is done by approximating the limit cycle oscillation with 
a Sinusoidal oscillation employing a least-square criterion. 


Meperiments show that the oscillator with quantizatic@y ulwcys 





exhibits limit cycles with periods which can be as large 

as several thousand or more samples. Therefore, the aver- 
age deviation of the limit cycle fron the ideal sinusoid is 
Mmemstant over each period of oscillation. This is contrary 
mera result reported by Rader and Gold [12]. Their formula 
indicates that the average deviation increases with time. 

The latter conclusion is not verified by experiment. Their 
underlying assumption of uncorrelated quantization noise does 
moc hold for the digital oscillator. 

Comparison of experimental results with the linear oscil- 
Bator indicates that a small offset in frequency and ampli- 
buce is present. It is verified that the limit cycle oscil- 
lations are nearly sinusoidal because the average deviation 
from the vredicted amplitude is small. 

mee those examples tested, the offset in amplitude and 
mae average deviation from the amplitude are practicaliy con- 
Mee FOL a large range of initial conditions. The offset in 
frequency decreases linearly for an increase of the initial 
Bencaitions. This important conclusion indicates that any 
Gegree of approximation for a specified sinusoidal oscil- 
lation can be achieved by either scaling the amplitude if the 
quantization step-size is constant, or by decreasing the 
quantization step-size if the amplitude is constant. The 
rules, deduced from the strictly experimental data, are im- 
portant: if the accuracy of digital generation of sinusoidal 
Seeitllations is considered. 


Comparison of experimental data obtained for 22° “7:de tyre 


os 





Guantization with the experimental data obtained for round- 
off cuantization shows that roundoff should be preferred over mnagni- 
tude truncation. With roundoff guantization a better degree 


of approximation of a sinusoid can be achieved. 


fee NN ANALYSIS PROGRAM FOR ZERO-INPUT LIMIT CYCLES. 

The analysis program for zero-input limit cycles in 
@eeond—-order digital filters with roundoff quantization is 
based on the filter configuration presented in Section III.C 
and depicted in Fig. 3.4. The difference equation repre- 


senting this model is repeated here for convenience: 


x(n) = -[a-x(n-1)], - [b x(n-2)],. (4.10) 
To compare the analytical results of Chapter III with 
the actual limit cycles it is desirable to enumerate aii 

Possible limit cycles for a specified set of filter coef- 

Pm2crents a and b. 

The algorithm for the program is based on the following 
lemma. 

Lemma: Given the difference equation (4.10), the response 
of this nonlinear difference equation is uniquely 
Secemeived mtom amymchosice ofeani tials cond? t1ense 

Mmeoot: Specify any initial condition x (1) and x (2). The 

gnput-output characteristic for a roundoff nonlinearity as 

G@é@épicted in Fig. 3.2 establishes a single-valued relation- 

ship between the input values to the nonlinearity and their 

Output values. Thus (3) 1S uUnicuely defined by (4.207. 

Using x (2) and x (3) the value for x (11) 1s uniquely 


eZ 





defined by (4.10). Repeating the jterative process to time 
mr. where n is any integer greater than two, establishes the 
unique response of C10) eens ane edchaere mau observation, 

it is noted, that uniqueness of solutions for an equation of 
the type (4.10) is always assured if the nonlinearities 
define a single-valued relationship between the input and 
the output. 

Consider the result of the lemma ina GLEferent Convex. 
Let the successive value phase-plane for second-order digi- 
tal filters be defined in a cartesién coordinate system with 
the x-axis representing x (n) and the y-axis representing 
x¥(n-1) (compare with Section TIIl.F). Once a state-point is 
chosen in the phase-plane, the resulting state-trajectory 
is uniquely specified. A limit cycle is recognized by the 
observation that the sequence of state-points constituting 
the limit cycle is represented by a closed curve if the 
Mimat cycle state-points are connected by straight lines. 

In order to enumerate all possible limit cycles ina 
specified area of search for a given set of filter coefl— 
mpevents, 1t seems necessary to apely all possible Tega te 1! (amu 
Peeaations or to start the state-trajectory from ale eGoecle 
ble state-points in a phase~plane which extends to the largest 
possible number specified by the dynamic range of the re- 
Beective filter in either dimension. However, this is 
neither realistic nor necessary. 

After some initial experimentation it has been found 


lL, & wee. i 


that only those initial conditions or state-points 





be applied to the difference equation which lie inside the 


square delineated by 
een) |= alee ye one (BD), 


The limit k is constructed from the bounds (4.3) and (4.5) 


as 


eo ae a, oe (4.12) 


Hee 1-|a]+b 
The constant g is a safety factor, which is included to in- 
vestigate all possible limit cycles. For the computer runs, 
values of a between 5 and 7 have been tried. If the initial 
conditions are chosen as described above, it then remains 
to count and record the different limit cycles. 

Anotner very important consideration about the experimen- 
tal implementation of the filter algorithm has to be stated. 
The solution of the difference equation (4.10) for given 
filter coefficients a and b and a given state-point Ce) 
and * (x-2) has to be free of any conversion errors if the 
decimal numbers a, b, Ta) and Shee are converted to 
machine numbers as they are represented internally in the 
computer. 

For example, assume that a = Soe If binary represen- 


tation of numbers is employed in the computer, the coefficient 


cannot be stored as a computer number, because 


ron 


(1.2)45 = (1.0011...).. 


Therefore a has to be stored in the computer as 
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a’ =a t A, (4.13) 


wnere A = cenversion error. 

Tt has keen shown in Chapter II, that the result of in- 
exact representation of filter coefficients amounts to a 
Shift in the pole positions of the digital filter. For the 
present investigation such errors must be avoided. Exact 
representation of numbers is one of the chief reasons why 
the analysis program for zero-~-input limit cycles is written 
in PL/1 [34]. This computer language ailows the use of a 
Gecimal arithmetic mode, where numbers are stored and opera- 
ted on in "“vacked decimal aera = and no” COnVversion errmens 165 
Ene above eee neo. ene can occur. Another reason for the 
choice of PL/i is the relative ease with which the delicate 
mee manipulations for the anaiysis program can be hendled. 
The analysis program is listed at the end of this disser- 
fation. 

A wide variety of values for the filter coefficients a 
and b have been used for computer runs with the analysis 
meodram. For Fig. 4.1 those representative values of a and 
leare indicated by an X for which the results of the compu- 
mer Simuiation are compiled in Appendix B. As an example, 
the computer results for a = -1.8 and b = 0.937 are dis- 
played in Table 4.1 and Pig.4,2 at the end Gf this chapter, 


metable 4.) all possible limit cycles in the area of search 


ots 


Sores 


Sp) 
0 


( 


@) 
ee 
2 
( 


iS 


[34], p. 27, 28. 
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are enumerated. They are labelled by an identification 
number and the frequency F = £/t. and the values of the 
limit cycle points are printed. Furthermore, the approximate 
frequency fi o/ Ea - 0.006 (see formula (3.59)) and the ampli- 


tude bounds 


. 2085: 2 A ae 
A 5. 7.937, from formula (4.3) 
A, == ee = 7,299, from formula (Ax So) 
1-|a|+b 


Mee stated. Limit cycle #1 exceeds the bound given by (4.3), 
while limit cycles #2 to #5 stay below hiss bound... “ne 
zero-frequency limit cycles #6 to #10 (including the trivial 
case where ch = ee = 0) stay well inside the bound 
Bees, which is expected, hecanse this bound is exact. 

The corresponding Stace tie he aise curaac displayed in 
mag. 4.2. The x-axis represents x (1) Annes Varues dle 
labelled in the top line. The y~axis represents etal and 
its values are labelled in the left column. A States Gece 
jectory is constituted by those state points which are de- 
signated by the same number. This number is identical with 
the limit cycle identification number given in Table 4.1. 

For example, consider limit cycle ee Sas eee ace 
jectory is formed by the 14 state points designated "2", 
Men as (3,0), (5,3), (6,5), (6,6) and so on. The trajec- 
tory is very close to an ellipse, which indicates that this 
limit cycle is nearly sinusoidal in nature. This is not 


true for limit cycle #1, which shows some aéyiations Ae se 
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Beiptical shape at the state points (6,7) and {(-6,-7). A 
close inspection of all the data compiled in Appendix B 


results in the following concluSions: 


a) The amplitudes of limit cycles with frequency 


Fh 


= 0 or = are well inside the bounds as given by (4.1) and 


S 
(4.5). The amplitudes of limit cycles with frequencies such 
iE 


mat 0 < — < = are well inside the bounds given by (4.1) 

and aa This is expected, because these bounds are exact. 
b) Most, but not all, amplitudes are below the value 

given by (4.3). The severest deviations from (4.3) which 

have been found are 5 and 6 quantization units. The re- 

Spective limit cycles are exhibited in Table B.u15 “and BatGo.: 


Appendix B. This result is summarized in the following 





jtabie: 
Value of Limit cycle Amplitude of Bound 
a and b Number lame Cycle Trem (aes) 
om —-].4, 2 238 [18.519], == AC 
pe 0.973 S 19 
4 19 
6 20 
y Zo 
8 Zk 
9 20 
126 20 
a= -1.74, 2 ey [11.999], = ll 
b= 0.95833 


- 


The reported exceptional cases have amplitudes which are 





inside the bound given by (4.4). It is worth noting that 
without the analysis program for zero-inout limit cycles, 
the exceptional limit cycles reported above would probably 
Mave been overlooked. 

c) A comparison of the successive value phase-=plane 
Mots from Figs. B.1-5 with the ones from Pil G comings.) ll 
shows that they are symmetric arounc a straight line at an 
angle of 45° for the former and around a straight line at 
an angle of 135° for the latter. The GLStElnquashing Lacren. 
between the two sets of phase-plane plots is, that a < 0 in 
the first case, and a > 0 in the second case. For a= 0, 
no symmetry axis can be determined (compare with Fig. B.6). 
The change in the symmetry axis with the change of sign for 
fhe coefficient a has been predicted in section III.F. In- 
Spection orf the limit cycle sequences in the corresponding 
tables B.1-5 and B.7-11 shows that the three lemmas from 
that section apply. 

d) The parameter plane from Fig. 4.1 shows the regions 
Meeectali lity for the digital filter with roundoff quantiza- 
ti0n. The region for those limit cycles with frequencies, 


euch that 0 < f/f. < has been derived in section III.D. 


1 
pe 
The remaining regions for limit cycles with frequencies at 
zero or at the Nyquist frequency (everything inside the 
triangle except the shaded region for asymptotic stability) 
and for-asymptotic stability have been derived by Jackson 
[27]. The boundary of the triangle is obtained if the unit 


> 


Circle in the z-plane is mapped into the parameter r’7ne 





Pech the help of the equations 


oe aed eCr- (4.14a) 


t~ 


+ b> fal. (4.14b) 


Moerig. 4.1, the limit between complex conjugate roots 
- =m < 0) and real roots ee - 4b > 0) for the linear 


mercer 1S shown also. 


Z_eecCOMPARTSON OF THE AMPLITUDE BOUNDS 

For comparison of the different amplitude bounds de- 
rived in Chapter III, a FORTRAN IV program has been written 
to compute the bounds given by (4.1) and (4.2) for repre- 
sentative values oe amand bi The pregmean Gs btsoreO seen 
end of this dissertation. Since the bound given by (4.3), 
(4.4) and (4.5) can be easily computed by hand, their evalua- 
tion is not included in the computex program. 

The bound given by (4.1) is based on the application of 
Lyapunov functions. The formulas derived in section III.D 
are directiy applicable. They are used to compute the bound 
Mmeemvyalues of b = 0.5, 0.75, 0.83 re, Ores. 7 5 ae 0.9 and 
Varying values of a, such that Ja| < 1+ b. The results of 
moms Computation are displayed in Fig. 4.3. 

Seemoound given by (4.2) is Gdifftemlt to compute, be- 
cause several determinants have to be evaluated. To avoid 
the awkward evaluation of determinants, a different algorithm 
mame the one given by (4.2) is employed in the computer 


program. The bound (4.2) has been derived from the matrix 


eS 





equation (3.34) which is repeated here. 


AX = €. | (4515) 
Meethnis equation is solved for x, such that 


os fate 2 Be, (4.16) 


AN 


mae bound on x can be written as 


n q . 
|| A gay r (4.17) 
because |e, | SeljO@cer all 1 = 162, see qea, Daewelenentes 
=a 


ag of (4.17) are the elements of the matrix inverse B =A 
me (4.16). The formula (4.17) is identical to (4.2). 
Equation (4.17) has been used for the evaluation of the bound 
Mueeeeea Of (4.2) because matrix inversion requires less 
computation than the evaluation of determinants. The re- 
Miles Of the evaluation of (4.17) for the same values of a 
and b as used for the evaluation of the previous bound, are 
displayed in Figs. 4.4-4.8. The difference between the 
mroures results from the different choices for the period of 
the limit cycle qT, where gq is chosen such that q = 4, 5, 
m7, 8. A closer inspection of the curves of Figs. 4.4-4.8 
meveals some very peculiar characteristics. For some values 
of the coefficient the curves for different values of b 
merge. For example, in Fig. 4.6, the value of the bound 

1s about equal for values of a around zero. For other 
values of a the bound peaks, exhibiting mostly two pro- 
meunced maxima, which are well apart for the differe: ¢ 


values of b. 
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This behaviour is explained if one realizes that limit 
Beyeles occur only for those values of a which are around 
mae peaks of the curves exhibited in Figs. 4.4-4.8. That 
this is true can either be verified with data obtained from 
Ene analysis program of the preceding section or by calcu- 


lating the approximate values of a which correspond to the 
if 
Jimit cycle frecuencies z— and which are possible for a 
S 
M@eciried period of qT. If q is specified then, from section 


= P are possible, where 


q 


rh 


O 


{ 


mii.Ee, the frequencies 


n 


2p cle . (4.18) 


and both p and q are integers. Using the approximate ex- 


pression For the frequency (2.60) the values of a and n/a 


mee related by 
- 27P 
ee —-2 COS aka (Aro) 


mere p = 0 and 2p = gq, one obtains a = -2 and a= +2. These 
Values of a are outside the graphs of Figs. 4.4-4.8. How- 
meer tor q = 8 (compare with Fig. 4.8) one obtains the fol- 


lowing values of a for which Limit Gyertes “Cam occmu: 


p f/f. a 
0 0 -2 
1 1/8 -1.4 
2 1/4 0 
3 3/8 +1.4 
4 1/2 1, 


14] 





These values are in acceptable agreement with the location 
of the peaks exhibited in Fig. 4.8. 

There remains an obvious question to be answered. What 
meaning does the bound (4.14) have for those values of a 
which are peieeen the locations of the maxima? The answer 
is that for these values of a the bound (4.14) has no mean- 
mng for the zero-input limit cycles, because there are none. 
Mees pOrtion of the curve representing (4.17) is valid for a 
Sequence of the ¢« in (4.15) for which a solution of the 7 
Mecording to (4.16) is possible, but this solution does not 
represent a valid zero-input limit cycle. In other words, 
me an arbitrary sequence € (which is not the result of 
quantization by roundoff) is used as the driving function 
Mer the second-order system (4.19) a limit cycle results 
Meee a proper choice of the coefficient a. This limit cycle 
hs not a valid zero-input limit cycle. 

The different bounds are now compared. This can be 
done directly from the graphs for the Lyapunov bound (see 
meg. 4.3) and the bound defined by (4.2) (See Figs. 4.4-4.8). 
Mmewshould be noted that the scales for the x-axis of the 
Beaphs Pea oo ana = Pige, 4.424) 8.are dutterent, waide 
the scales for the y-axis are equal. The comparison of the 
graphs shcews that the Lyapunov bound is always greater than 
mee bound (4.2) regardless of the choice of q. Both types 
of bounds generally approach infinity for |a| approaching 
(l+b), however the Lyapunov bound approaches infinity much 
Faster than does the other bound. It should be noted. how- 


mee, that Fig. 4.5 (q = 5) and 4.2 (gq = 7) de not show the 
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Bapad increase for a ~ (li+b), because for q odd, a value of 
Meesuch that 2p = g, does not exist and therefore no other 
peaks than the ones on the graph are expected. 

The two bounds based on the effective value linear 
model are given by (4.3) and (4.4). Evaluation of these 
meendgs for b = 0.5, 0.75, 0.83 ae OG? 5 HOO eee lcs 
mee, 4, 5 for the bound (4.3) and 3, 6, 9, 12, 15 for 
the bound (4.4). Comparing the latter bound with the curves 
on Figs. 4.4-4.8 shows that the bound (4.4) is below the 
values for the bound (4.2) in the region of interest for 
O@ = 4, 5, 6 and above the values for the bound (4.2) for 
me 7,0o. However,-from the data of the preceding section 
one Can be reasonably sure (but not certain) that the bound 
Mee wail not be exceaded. 

In summary then, the following rules and observations 
eee pertinent: 

eye The Lyapunov bound from (4.1) is exact, but overly 
pessimistic. For this reason, the bound seems to be of 
Mrttie value for practical applications. 

b) The bound from (4.2) is exact, reasonably close to 
mace Ooserved limit cycle amplitudes, but not easy tO Coma 
pute, especially if gq is large. 

c) The bound from the effective value linear model 
(4.3) is easy to compute, but is not exact. This bound and 
is SompantONnsrOreehe "exCepelonal Case given by (4-4) aie 
most readily appiicable. If an exact bound is needed a 
eneck calculation using the bounds (4.1) and (4.2) can nh 


performed. 
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fee f£HE DIGZTAL OSCILLATOR 

In example 1 and 2 of section II.D, two digital oscil- 
lator~arealizations are investigated with respect BONCOe Tia 
cient accuracy due to finite representation of numbers. 
For this section, the digital oscillator defined by the 
Gifference equation (4.6) is again considered, this time 
with respect to quantization errors introduced through round- 
Meewor truncation of the product~term ax (n-1). Because 
b= 1.0, the effective values of the voles of the linearized 
version of (4.6) are always on the unit-circie in the z- 
plane, regardless whether roundoff or megnitude truncation is employed. 


memmas been discussed earlier tnat (4.6) indeed describes 


ir 


(A Ss 
Lote 


nw 
<P) 


2s been 


é 


Smmose1!tiator. The oscillator de ; 


¢ 


mavestigated by Rader and Gold [12]. Assuming that the 
merors introduced by quantization of the product fon 

Be n-1) are statistically independent and its probability 
Gensity function is uniform they evaluate the mean squared 


noise in the output signal caused by roundoff as 


NO 
e| 
NlovN 


> E ; (4.20) 
O 
where Ey = quantization step-size. 
Equation (4.20) indicates that the mean squared noise 
increases linearly with time nT. It is therefore expected 
meat the sinusoidal output of the digitai oscillator cett 


contaminated by roundoff noise until the output is no loagir 
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Mmeeognizable as a sinusoidal signal. 

The conclusion above is unreasonable from a physical 
point of view. Consider the linearized version (4.8) of 
the difference equation (4.6). Together with (4.7b) it is 
deduced that the solution of (4.6) must approach the solution 
of the equivalent linear difference equation (which is a 
mmusoid) if the quantization step-size and thus ¢€ in (4.7b) 
decreases to zero. From (4.20), however, it is concluded 
that the mean squared quantization noise a7 increases with- 
Sat bounds regardless how much the quantization step-size 
is reduced. 

im contrast, the simulation of (4.6) shows eee foes 
Srtener roundoff or magnitude truncation, limit cycles with periods 
Memeo several thowsanc scamples are produced. Singe the 
Shape of these limit cycles, except for small offsets in 
frequency and amplitude and a small deformation of the 
samples, is essentially sinusoidal and the mean squared 
noise is independent of the time nT the result of (4.¢0) is 
Met verified by the available experimental data. For the 
Becillator defined by (4.6) - as for any other limit cycle 
Sscillation due to quantization - the stochastic approach 
is not applicable because the roundoff noise is correlated 
With the output signal and the different noise sources are 
not statistically independent. Therefore, only a coherent 
Belysis is applicable. 


mehe Existence of limit cyeles for (4.6) has been 
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mmagested to the author by J. F. Kaiser? im a private com- 
munication. Recently, Todtli and Pfundt [29] have reported 
about limit cycles from digital oscillator realizations. 
Their work, however, emphasizes the hardware realization 
[ema Gigital oscillator using logic circuits. 

As a new result a heuristic bound on the frequency cf 
the digital oscillator is now derived. If the difference 
equation (4.6) is linearized and roundoff quantization i 
assumed, then from (4.7a) and (4.7b) one obtains 


ax(n-1) + 0.5 + 6¢(n-1) = ax(n-1)4+ ex(n-1). (Aman) 


Bence 6(n-l/is bounded by 1.0, a bound on ¢« is evaluated as 


lel < (4.22) 


For magnitude truncation quantization the bound on ¢€ is larger by a 


MmaetOr Of two, such that 


1.0_ 


- ; (Ae 3) 
x (n-1L) 





cm 


Meemcoctiicient a' of (4.7b) of the digital oscillator can 
now be used together with (3.59) to compute upper and lower 
bounds on the frequency of the limit cycle oscillations. 


This estimate is given by 





Hh} Hh 
jo 


= = Coen play (4.24) 


WN) 


al : A : % . 
u. ©. heteen, Bell’ Teleprene Laboratories, ince, 


Murray Hill, New Jersey 67971. 
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Up to this point the derivation of (4.24) has been exact. 
However, for the calculation of the bounds on the frequency 
a choice has to be made about which x (n=l) should be used 
eee Calculation of e¢« from (4.22) or (4.23). If 

- ee = ©. NO. roumNdoLrf or truncakticom occurred anadwce =a 

in general x(n-1) can have values between 1 and the maxi- 
mum value of oe The difference in frequency between the 
linear oscillator and the quantized oscillator does not 
depend on the ¢€ evaluated for one specific sample cae 

but on the average € evaluated from all the samples in the 
limit cycle. For this reason oe tom, (4a 2 23) Or 4 2 aes 
been chosen here as the average amplitude of the limit cycie 


which is estimated by 


Ont aS = 
~ 
ie 





4 =N 


ae 


ay™N 
J 


where A is the amplitude of the limit cycle. From (4.22) - 
eee >) it follows that the frequency of the quantized 


megital oscillator is bounded by 


de 
iu = a At O i ads ¢ acls eel 
aT OS ( > at TA ) < (=—) < oT CoS ( a ta: 
s QJ 
(cA on) 


where A = 0.5 for roundoff and A = 1.0 for magnitude truncation. 
The heuristic derivation of the frequency bouncs has 

been verified by experiment. A comparison between the 

observed frequencies of the limit cycle oscillations and 

the computed values for the bounds indicates that the bounds 


mre not exceeded for those examples considered in ths 
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section. Next the simulation program for the digital oscil- 
ator is considered. 

For the purpose of this section the difference equation 
(4.6) is implemented by a computer program, cailed Analysis 
meogram for a Digital Oscillator. It is listed at the 
end of this dissertation. The program is written in FORTRAN 
IV. To avoid any errors due to number conversion from 
decimal to binary representation (compare with section IV.B), 
all arithmetic involved with solving (4.6) is done in an 
integer mode. This is achieved by scaling all decimal frac- 
tions until an integer results. By proper bookkeeping of 
fae Scale factors the correct arithmetic result is obtained. 

Another important aspect of the computer implementation 
M@@eeris the variation of the onantization stenp-size. For 
programming purposes it is easier to keep the quantization 
step-size constant and increase the initial conditions and 
mus the dynamic range of the oscillator response. That 
mois Kind of scaling is equivalent to varying the Guan eis 
Zation step-size can be seen from the following simple 
example. Suppose (4.6) is solved for a = -1.86, x (i) = Q 
and x (2) = 1 with roundoff at the second digit after the 
decimal point. Then Ge = [1.86]. = -1.9. Now, (4.6) 
is again solved for the given a and aby but for x (2) eee 
mea with roundoff at the first digit after the decimal 
Moint. “Then Go = [18.6] = -19.0, and, after scaling 
down by. a factor of 10, the result from the second examole 


equals the result from the first example. 
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PELeer this introductory description oO. ene see csean 
algorithm, the mathematical model us2d is now presented. 
Gaven values for the coefficient and the initial conditions 
nw aw 
x(1) = 0 and x(2) = M, the program performs a comparison 
between the responses of a linear, infinite precision digi- 


mal OScillator and a quantized digital oscillator. 


The pertinent 
characteristics of the linear oscillator, amplitude and 


meeaquency, are computed from the results of Chapter II as 





£ 

Op ae meals a 

ae a ee ( x) (4.27) 
S 

and 
PR SS (2.28) 
Zee 
Sin ( - ) 





TO be able to compute frequency and amplitude of the 
gGuantized version of the digital oscillator some choices 
about the necessary approximation for the limit cycles have 
membpe made. Since the resulting limit cycles are nearly 
Sinusoidal a polynomial approximation has been ruled out 
immediately. A least square approximation has been prefer- 
red over a discrete Fourier series expansion because the 
First is easier to calculate. A discrete Fourier series 
expansion of the limit cycle is expected to show a broaden- 
ing of the spectral line which represents this limit cycle. 


The width of the spectral line may then be a measure o- 


Geviation from the ideal sinusoidal response. This subject 
mec tO be left for further research. 

The least square approximation for the generated limit 
cycles iS now considered. It is assumed that the samples 


of the limit cycle with period gT and frequency f/f. 
ee a COG oe he sa pe wee CC el (4.29) 


are deformed versions of a sinusoidal response, described 
by 

Lo, A sin wor, A sin ee er oe Saen woatl. (4.30) 
Then, the amplitude A of the sequence (4.30) can be esti- 
mated by minimizing Ehewmrollowing COcmerUneGtion sie ny lintel 


corresponds to the sum of the squared differences between 


the members of the seguences (4.29) and (4.30), 


I = y Ix(i) - A sin (i-1) wot). (4.31) 
i=1 


mits minimized, if 


o- = 0, (4. 


- 32) 
oA 
and 
2 
ae or (Ameen 
JA 





ae y [2A sin’ (i-l)w T - 2x(i) sin(i-l)w 1). 
OA je | O O 
(4.34) 
2 q : 
5 mai ) sin (1-l)o T >see id 24 
oA isl 
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mem (4.35)2t is seen that I is indeed minimized if the 
mendition (1.32) is applied to (4.34). The estimated 


A 
amplitude A obtained from (4.34) is 


See) sin(i-l)w f 
—-— (4.36) 


re Get 3 
O 


, 
The denominator of (4.36) can be simplified, such that 


Oca, sin(i-l) wT. (4.37) 


lta © 


QO, NM 


L=1 


_— 


“a 


AS is expected from a least square approximation, Ais a 
weighted average. The average deviation from the ampli- 
hude, or the measure of deformation, is obtained by com- 
Puting I from (4.31) and defining the measure of deforma- 


won as 


(4.38) 


With the numbers from the least square approximation of the 
mmit cycle available, it is now possible to compare the 
ideal response from the linear digital oscillator with the 
limit cycle response from the quantized digital oscillator. 


BOr a specified coefficient a and initial conditions 


. See, for example, Hildebrand [35], p. 273. 


oa 


nw 


meer) = O and x(2) (where x(2) varies between 1 and 1200) 
the absolute differences in frequency and amplitude are 


computed as 


fe 
7 = ce a 
FDIFF | (Fo) ieaysa ale (4.39) 
ADI®F = |A ~A |. (4.40) 
ve 
For the expression (4.39), ‘F-) Linear 1s computed from 


(4.27), and p and q are integers obtained from the actual 
limit cycle by counting the number cf sign-changes 2p be- 
tween samples, and the period of the limit cycle gq. For 
the expression (4.40), A is computed from (4.28) and A 1S 
Bempouted from (4.37). 

Computer runs have been performed fur valuésS of a be- 
tween -1.10 and -1.90 and initial conditions where en = 0 
and 7D) varies from 1 to 1200. For each specified set of 
numbers a, 21) and a the limit cycle response is ob- 
Gained for roundoff quantization first and for magnitude truncation 
quantization second. The data is collected i ree B.l7= 
B.32 in Appendix B. For explanatory purposes, the data for 
a= -l1.1is presented in Tables 4.2 and 4.3 at the end of 


this chapter. The columns in the tables are labelled as 


follows: 


‘AMP = amplitude A of linear oscillator, 
evaluated from (4.28) 
QO = perlog of Jimit ‘cycle, 


[Lt 
(Nn 
NO 





FDIFF = absolute difference in frequency, 
defined by (4.39), 


ADIFF = absolute difference in amplitude, 
defined by (4.40), 


DELTA = measure of deformation én defined 
Die aic e 
mena Jimit cycle period aT is ee than gq = 5000, the 
evaluation has been stcpped and the entries in the table are 
arbitrarily set to q = 5000 and zerc for the other variables. 
A numerical example is now considered to iilustrate the 

use of the tables B.17 - B.32. Suppose the following speci- 
[reactions for a digital oscillator are given: 


— 


f = oscillator frequency 1¢00 Hz + 1Hz, 
O 
Pe anorrtude 1 + OF@h, 
gq = 16 samples per oscillation period. 


First the sampling frequency f. is cetermined from (3.57b), 


ae 
pee a 6 hae 
Ss p ue 


Then the oscillator coefficient a is computed usiny 


oP ol 
a q 16 
and 
a= -2 cos ap = -1.85. 


If the oscillator is realized using roundoff quantization 


meores B.29 and B.31 apply. FDIFF is computed as 


Uo 





FDIPF = ———=—» = 0.625-10° 
Gee ed 
Beeering table B.31, (a = -1.9), it is found that for 


fe 1000, FDIFF = Geno and the frequency specification 


Memet, even considering a margin of safety. The corres- 


ponding value computed from the bound (4.26) is Cielie. oa 


Pealing the amplitude by a factor of omen it is found that 
the amplitude specification is met, because the average 
Seviation from the amplitude from table B.3l is 4.7 for 
meeeelood or 0.0047 < 0.01 for A ~*~ 1. For an amplitude of 
A= 1, the required quantization step-size is TN Oeaae This 
1s obtained from scaling the quantivation step-size l, 


Om wiich the results in the table are based, bv a factor 


merogdO. This corresponds to 3 significant digits if 


decimal arithmetic is employed or to 10 significant 


pee el 
log <2 
Mees if binary arithmetic is used. A check in table B.29 
(a = -1.8) verifies the preceding approximate calculation. 
Peeneck in tables B.30 and B.32 for magnitude truncation shows that 
more bits are needed to meet the frequency specification. 
For A ~ 3000 both the frequency and the amplitude specifi- 
Preations are met. This corresponds to 3.477 significant 
meenmal digits or 12 significant bits if binary arithmetic 
is employed. | 

From the preceding discussions it is now possible to 


eieaw the following conclusions: 


zo 
oe tie Tseguency —_— = = Ona orac EVea cl 
at 


ae - 
Cc 


igital qfieii- 


lator realization can only be realized in discrete steps. 
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This is due to the fact that the coefficient a, which deter- 
mines the frequency, 1S represented by a finite number of 
emoits (compare with Ch. II). In addition, a small offset 
from the noininal frequency is present due to quantization 
@eeproduct-terms. This offset is tabulated under FDIFF. 

The offset in frequency decreases approximately linearly 
with a corresponding increase in amplitude. This decrease 
is more rapid for roundoff than for magnitude truncation. Fer 


m~ 


eee 1000 and a quantization step-size of 1, which corresponds 


ees : “ 
Deo A PewsSCalegmaown such 


that A ~ 1.0, the offset in frequency is about Ge for 


mera quantization step-size of 10. 


: —-4 
meunaorf and apnpout -10 for magnitude truncation as obtained from the 


tables of Appendix B. The corresponding values computed 


—A _ ae Ome 
26 are, eround 149 fow~@naenieegunk and about 


cA 


from the wound (4. 
5-10 ° for magnitude truncation. 

Igy The offset in amplitude is practically constant over 
the range of amplitudes considered. The corresponding 
offset, expressed in percent of the amplitude, decreases by 
a factor of 10 for every increase of the amplitude by a 
maecor of 10. 

c¢) The deformation of the limit cycle compared with 
the ideal sinusoidal response is, again, practically con- 
Stant over the range of amplitudes considered. The small 
numerical values for the deformation verify the initial 
choice of a least square. approximation for the limit cycle. 


d) -In summary, and as a conseouence of the preceding 


Pemarks, it can be concluded that any degree of appre inde 


to an ideal sinusoidal response can be achieved with the 
Maanctized oscillator defined by (4.6). Thus, any elaborate 
scheme to reduce the deformation of the response (for ex- 
ample, resetting the oscillator as proposed by Gold and 
Raager [5]) is unnecessary. 
fe | =OUMMARY 

Wee results from three computer orograms have been 
Meesented to verify the analytic results of the preceding 
chapters with experimental data. 

imewanaiysis program for zero-input limit cycles, 1.e., 
Eeaesnatural response of a two-pole digital filter, enumerated 
all possible limit-cycles for specified filter coefficients 
a and b fer the initial conditions studied which have been 
Bmosen to cover a broad practical range. The limit cycles 
are tabulated and plotted on the successive vaiue phase- 
plane. This data is compiled in Appendix B. The phase- 


S 
, depending 


plane plots showed a symmetry axis at 45° or 135 
Meeewer a < 0 or a > 0. The phase=-plane plots of the two 
Meecs Ot limit cycles for coefficients -a and b and coeffi- 
Saents ta and b are equal in shape. It is thus concluded 
that a bound computed for the first set of coefficients is 
equal to the bound computed for the second set of coeffi- 
Cients. In other words, a change in sign of the coefficient 
a does not change the value of the respective amplitude 
bound. 

The recorded amplitudes of the limit cycles stay inside 


+ 


more Hounds detined by (4.1), (4.2), and (4.5) as exmeereed, 





because their derivation is exact. Exceptions for the 

bound (4.3) are presented. It was concluded that the bound 
(4.2) should be used if worst-case information about the 
dimit cycle amplitude is needed. The bound (4.4) is most 
easily applicable. However this bouind can only be considered 
Seeeie-Oof-thumb. The numerical comparison of bounds (4.1) 
maa (4.2), using data computed with the comparison program 
for the above mentioned bounds, shows that the bound (4.1) 
derived from one Lyapunov function of the digital filter, 

is primarily of theoretical interest because of its broad- 
ness. The results from the digital oscillator simulation 
program were employed to demonstrate that the stochastic 
@pproach for estimating the quantization noise due to round- 
Met Or truncation @fter multiplication as discussed by Rader 
and Gold [12] fails to agree with experiment. The inter- 
pretation of the experimental data shows that only a co- 
herent or deterministic analysis can iead to useful results. 

The data also shows that any degree of approximation of 
Memetoeal, 1.€., infinite precision, digital oscillator can 
be achieved by reducing the quantization step-size. This 
is equivalent to specifying more significant digits for 
Meta and filter coefficients. 

It seems appropriate to comment about the relation be- 
tween sampling time T and the number of significant digits 
used to represent sampled data [40]. This was first 
memeioned in Chapter II, where finite representation of til- 


Mer cocrficients was studied. Tt was shown there Gale 





sampling too fast may result in an undesirable response. 
Consider two neighbouring samples of a function f(nT). 


Connect the sample values by a straight line with a slope 





Beeven by 

a. K = constant, | (a 22 13 
where Af(n}) = £(n) - £(n-1) denotes the first forward 
difference of the function f(nT). I£ finite representation 


of numbers is used, only those changes in the functional 
values can be distinguished which are larger than the 
gGuantization step-size determined by the number of Signi- 
Ficant digits. Denote the quantization step-size by A. fit 


is reasonable to reguire that 


< (4.42 
A Nate ee (4 ) 
For a sinusoidal signal with amplitude A = 1, and 
en) vie OL Lows mia tamer s@a- ot pe e Picom: wines 
a max S 


Simple calculation it can be concluded, that it is useless 
to sample a normalized sinusoid faster than with sampling 
meequency f — a The general relation between sampling 
frequency £_ and quantization step~size A is derived from 


freot) and (4.42) as 


= 
£.= i (4.43) 


where K'= maximum slope between samples. The quantization 


step-size chosen is inversely proportional to the sampling 


frequency. 


aA 


As an area for further research reconsider the approxi- 
mation problem for the limit cycles generated by the digi- 
tal oscillator. For the treatment of this chapter a least 
square approximation has been chosen and the numerical 
results have verified this choice. However, it would be 
interesting to represent the limit cycles by discrete Fourier 
series and relate the expected spectral broadening to the 
deviation of the observed limit cycles from an ideal sinu- 


/ 
soidal response. 
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V. THE FORCED RESPONSE 


A. INTRODUCTION 

The natural or zero-input response of the quantized 
digital filter from Fig. 3.4 has been evaluated in the pre- 
ceding chapters. The linear equivalent of this filter has 
meyorpoles and no zeros in its transfer function. The forced 
response of general digital filters with both pees hand 
zeros is now analyzed with regard to possible limit cycle 
oscillations. This analysis is performed in several steps. 

First, the step response of the two-pole digitai filter 
is considered. As a new result it is shown that: the forced 
steady-state eee contains two components. The one 
component is a constant which is determined by the size of 
Mmemocetep input and the loop gain of the filter. ‘the other 
memponent is a limit cycle oscillation which is related to 
meee oO-input limit cycles described in section IV.B. 

Next, the forced response of tke same filter type is 
Considered for general, deterministic input Signals. As 
an important new result it VS showhistiat the: driven cause 
Gan be reduced to a zero-input case if the difference be- 
tween the response of the quantized digital filter and the 
Serresponding linear digital filter is considered. This 
difference signal is described by a limit cycle oscillation 
whose amplitude is estimated by the same bounds which have 
meen derived in Chapter III for the zero-input response. 
In the same context it is shown that both roundoff anc 


mEuncation quantization lead to limit cycle oscillations. 


ig a 


meang this result, it is concluded that roundoff should be 
preferred over magnitude truncation becavse the errors due to magnitud2 trun- 
cation are up to twice as large as the errors due to roundoff. 
The conclusions of this section are <cested by computer simu- 
HMation of a quantized digital filter with sinusoidal inputs 
of varying amplitude and frequency. As expected, the ampli- 
tude of the limit cycles is independent of the sinusoidal 
input and remains inside the bounds derived in Chapter III. 
Meee crequency of the limit cycles is unpredictable, but 
seems in most cases to stay inside a band determined on the 
Smewena by the resonant frequency of the filter and on 
the other end by the lowest zero-input limit cycle frequency. 

The second-order digital filter section with both zeros 
ana poles in ey function .of themegimivalent linear 
filter is studied in the following section. This general 
case iS important because all practical filters have zeros 
in their transfer function. The zeros are shown not to 
change the nature of the limit cycle. However, they in- 
fluence the magnitude of the limit cycle amplitude. Asa 
new result it’ is shown that for specified zeros the magni- 
Huge of the limit cycles in the output of the Gaga bay mie 
ter can be minimized through a proper choice of the filter 
Gonftiguration. If the zeros are located in the right half 


of the unit circle in the z-plane then the configurations 


=o )lCU;} U8 are to be preferred over their transpose 
2 3 | 
Seouncerparts she , st j a wr Li the zeroseare inthe 125 


MemMrrot che Unit circle che reverse is true. 
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Finally, higher order digital filters et@eneseaceade 
and the parallel form are considered with regard to limit 
cycles in their outputs. A bound on the amplitude of the 
limit cycles in the output of the parallel form is stated. 
A similar result for the filter of the cascade form can be 
formulated. Each limit cycle output from one filter sub- 
section is the input to the next subsection and is fil- 
tered there and in the subsequent sections. To estimate 
the filtering action of the different stages in the filter 
cascade to which the limit cycle is input, it is necessary 
to know the frequency of the limit cycle with sufficient 
accuracy. This information about the frequency is only 
available for zero-input limit cycles. For limit cycles 
Poeenmare generated as part of the forged xesponse, it 
has not been possible to estimate the frequency with rea- 
sonable accuracy. This problem remains for future considera- 


ec y) . 


Peeeotae LNPUT TO THE TWO-POLE DIGITAL FILTER 

As an introductory example, the step response of the 
Ewo=pole digital filter from Fig. 3.4 is now considered. 
It is shown in the later sections that the result obtained 
for this simple filter configuration can be extended to 
more complex configurations, including those with zeros in 
the transfer function. The difference equation defining 
the digital filter from Fig. 3.4 is repeated here for 


convenience: 


A 


x(n) = [a x(n=1) 1, =D x(n-1) 1, =tetcetny ate (S22) 


iS 


For a step input 
eC) ee ce) 


where c 1S a signed constant. 

The response of the corresponding linear infinite pre- 
S@erOn digital filter 1s composed of a decaying sinusoid, 
superimposed on a constant, whose value is determined by 


the loop gain ( of the filter. It is therefore rea- 


ae 
teat 
sonable to expect that the step response of the guantized 
mortal filter is composed of a constant amplitude limit 
mere Superimposed on the above mentioned constant value. 
That this is indeed the case is shown theoretically and has 
been verified by computer simulation. 


Sear wee on - -~ -—— Fe Nw ewe BARS nm & as 
feet Su, Lei StEp LEeSpuilocr Yun cS ig aoe eae ots Sw cn 


roundoff quantization. Then, a similar development is out- 
lined for magnitude truncation quantization. For simplicity, assume 
mera < 0, b > 0. The development for a > 0, b > 0 leads 
to the same result. Furthermore, assume that the steady- 
state response of (5.1) contains two separate components, 


such that for some integer N 
Xx(n) =A + x(n), ig Ne (25 


“Aa 
ere the finite precision components of x(n) are defined 
as 


A 


Cons vane 


x(n) samoles of the limit cycle around A. 


Bemstituting (5.3) into (5.1) yields 


4 
~] 
Ho 





A + x, (n) = ~fa(Atx, (n-1))1-[b (Atx, (n-2))] te 


(na [Atx, (n-1)] +, 5= one 


~b[A+x, (n-2) ] + (0.5-S(n-2))4+c. (5.4) 


Separating the constant response firom the limit cycle re- 


sponse in (5.4) results in two equations. They are: 
rs E 
a Tee (om 
x(n) = -a x (n-1) + (0°. 5="0 (n=) eee x (n-2) 


ise 


(0.5-6(n-2)). (6) 


Fquation (5.5) is recognized as the steady-state response 
Semeeme COrresponding linear filter. Equation (5.6) de- 
fines a limit cycle which is eet weer tO, the Zereo-i1noee 
limit cycles discussed in Chapter III and, therefore, all 
the amplitude bounds discussed there apply to the limit 
Peeelbes defined by (5.6). It is important to note, however, 
m@eeethe roundoff sequences 6(n) are not only a function 
of x(n), bint Se a function of A, however, they are 
always Bounded by 1.0. The frequency of the limit eCyete 
defined by (5.6) is therefore a nonlinear function of the 
digital filter coefficients a and b and of the input and 
S@eput of the filter. 

The computer simulation of Che "digitale Liter (a...) 


Mas verified these results. The Littit cycles whict PCur, 


ts 
~J 
Oa 





together with the constant bias (5,5), are essentially but 
moe exactly the same as those which occur for zero-input to 
foe filter. 

Tt has been impossible to predict the limit cycle num- 
Mer, as defined for the zero-input case, for a limit cycle 
moeene Output of the filter for a sgiven constant value c 
Meche input u(n). For a variation of the input value c 
over a range of several hundred units a weak pattern in 
the repeated occurance of certain limit cycles is visible. 
However, due to the many exceptions from this pattern, it 
has been impossible to postulate any law relating the in- 
Bue value c to the occurrence of a particular Time lee 

The development stated for roundoff quantization is. now 
Meftedeca fOr magnitude truncation ouantization. Wsine identical 


assumptions as for roundoff, (5.4) is changed to 


A + x (n) aie aca oa) 


-b[A + x (n-2) ] +§(n-2) + °c. (Sid?) 


Separating the constant response from the limit cycle re- 
sponse results in similar equations as derived for round- 
off. The nature of the step response of a digital filter 
employing magnitude truncation is equivalent to the step response 
of the same filter employing roundoff. The amplitude 


bounds discussed in Chapter III are again applicable. 


Bee orENERAL INPUTS TO TWO-POLE DIGITAL FILTERS 


4 


The forced response of the tweo--pole digital 


4 : —« 
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big. 3.4 for a general input signal u(n) is studied in 

this section. The analysis of the forced response is re- 
meed to the analysis of a zero-input response by subtract- 
ing the fcrced responses of the quantized and the linear 
digital filter and studying the resulting difference signal. 
The forced response of the linear digital filter is given 
by 


min) = =a x(m-l1) = b x{(n-2Z2)) + ute). 5.30) 


eemeeorccd response of the quantized digital filter employ- 


ing roundoff is given by 


“Aw 


ee seen) Sons) hs (eg 


_ 


—h On) + (O0eS: = o H2)) ee une Coo} 


The difference signal d(n) between x(n) and x(n) is de- 


fined as 


d(n) = a) mae Seale) . Gaye Oe, 
Subtracting (5.8) from (5.9), one obtains for d(n) 
lei) = ~a d(n-1) + [O.5=—c-(n= 
ee Teel Or ones 2) hy (oa) 


where 6(n-1) and §(n-2) are numbers, such that 0 < |[é]< 1.0. 
Bem@ation (5.11) is identical in form to (3.14), which de- 
Pomea the zero-~input limit cycles studied in Chapter f1if. 
However, the roundoff sOgueneee 6(n-1) and 6(n-2) are not 


Aw 


meey a Eunction or d({n}), but shso a Function of x# 


7 





This can be seen from (5.9). The latter conclusicn has no 
bearing on the amplitude bounds, which were derived for 
f214) in Chapter init, Their derivation did not anelude 
any assumption about the specific nature of the roundoff 
sequences. The only condition used is stated with (3.14) 
and requires that the roundoff sequences are bounded. 
Maus, the amplitude bounds derived for (3.14) are directly 
applicable to the limit cycles defined by (5.11). How- 
ever, the above mentioned conclusion influences the fre- 
guency of the limit cycle because the frequency is now a 
Me@enlinear function of the digital filter coefficients a 
m@eeD, the amplitude of the limit cycle and, additionally, 
eeeeeinput signal u(n). For zero-input limit cycles the 
Freanencyv has heen anproxiimated by the exoression (3.59), 
Meeived from the corresponding linear filter. This approxi- 
mation is no longer valid for the Tamale Gyclesy Contato a a. 
mime rorced response due to the nonlinear dependence on the 
Ppa signal u(n). 

The foregoing development is now repeated foeneeee trun- 
cation quantization. The forced response of the quantizea 


Gigital filter employing magnitude truncation is given by 
x(n) = -a x(n-1) + $(n-1) 


—b eer, fo =o jee aia) = (517) 


pmeeracting (5.8) from (5.12) to obtain the difference sig- 


nal d(n) as defined by (5.10) yields 
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d(n) = -a d(n-1) + 6(n-1) 


= ocitie >) Gee (5.13) 


where 6(n-1) and 6(n-2) are numbers, such that 0 < |6|/ < 1.0. 
Magation (5.13) is identical in form to (3.68). However, 
the truncation noise sequences 6(n); are a function of ce 
as can be seen from (5.12). 

mor the zero-input case (3.68) it has been shown in 
Chapter ITI that limit cycles with frequencies Eft a. such 
tfmat 0 < f/f. <. oo cannot exist for magnitude truncation quanti- 
Memon. On the other hand, such limit cycles can exist in 
the driven case. This is now demonstrated by showing that 
Beevemcoctficient b of (5.13) in general has an effective 
wealue of b= 1 and limit cvele oscillations can he sus- 
fied. Suppose d(n~-2) in isso ccae negative number 
and en-2) ite (5.2). 5S emeOSlEive Numbers lies cocina 
Sewer has in general values, such that 0 < b < 1.0. 
Memeo rlows from (5.12) that 6(n-2) must be a positive num- 
ber. From (5.13) the effective value for b is defined as 


meeepesuch that 
POmcne et eo(i=2 je — —b din=2) . (Seay 


From (5.14) it is seen that there are many values 0 < b < 1.0, 
Pa -2)| > 1.0 and 0 < 6{n-2) < 1.0 which satisfy (5.14) 


such that b' 


i> tpeothemeveords, Eucm (214) and using 
the bound on 6(n-2),it is deduced that b' = 1 for valves 


oe ad(n-2) (and therefore, dir} since d(n-2}) is just 





delayed version of d(n))such that 


— 


Bi 
5 





flO S| GG ae (Sars) 


Tf (5.15) is satisfied limit cycles have to be expected. 
The same conclusion is reached for the case where d(n-2)> 0 

A 
em@emx(n-2) < 0. 

That this is indeed the case has been verified by 
computer simulation. While it has been impossible to pre- 
Smet the frequency of the limit cycle defined by (5.13), 
the amplitude bounds derived in Chapter III still apply, 
femammultiplication factor of two is included. This is 
necessary because the magnitude truncation error sequences are up 
Memewice as large as the corresponding roundoff error 
sequences. The nrecedinag discussion shows that miaguitude truncation 
Sm@eaner zation offers no advantages over roundoff gquantizaticn 
1f suppression of the possible limit cycles is contemplated. 

The results of this section were tested for sinusoidal 
inputs of various amplitudes and frequencies. The linear 
Operation of the digital filter is approximated in the 
Simulation program by employing double precision (16 signi- 
meee Gigits), floating-point arithmetic. The difference 
EMemal d(n), defined by (5.10), as recorded for n = l to 
MG@se After computation of 512 samples for d(n), it is 
assumed that the steady-state condition has been reached 
and the following 4096 samples are then used to compute 
an estimate of the discrete Fourier Transform for d{1- 


ales 


my cmoloyang the Fast Fourier Transtorm (YT) algo: 
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moj. The discrete Fourier spectrum of d(n) has been 

computed because initial experiments indicated that it is 
impractical to deduce the several possible frequency com- 
Ponents of the generated limit cycle by counting the num- 


ber of sign-changes of the samples and the period of 


r 
Mmimit cycle. “/ 
For roundoff quantization and one set of filter coef- 
Mretents a = -1.87, b = 0.95, resuits concerning the ampli- 


ieee OF the limit cycles are recorded in the following 
fole., The input signal to the digital filter is described 


= eee ty 0 
Iy a(n) A, sin If, nT 


. Range of Range of Median of |d(n) | 
fa : re re max 
ae (eC ee Sor ay aa ae 


BN a lee on - ae ee Maen Woomera eee 
Oe ee) Ce ee ee 


freouencies 
1 0.000977 to 0.28 2.56 to 12.14 Wo 
10 0.000977 to 0.25 1.79 to 15.34 10.0 
10 0.038 to 0.051 3.14 to 14.76 8.6 
100 0.000977 to 0.25 3.13 to 13.89 9.8 
1,000 0.000977 to 0.25 4.38 to 15.01 8.5 
1,000 0.036 to 0.050 6.14 to 12.19 10.9 
100,000 0.000977 to 0.25 1.78 to 13.90 9.6 


As expected, the amplitude of the limit cycles is in- 
dependent of the input signal. Using the two most easily 
computable amplitude bounds from Chapter III, (3.53) from 


the effective value linear modei yields 


ld(n) | < 10, foe 


mee’ (3.55) for tne exceptions from the effective ve 


oe 





linear model yields 
|Jd(n)| < 30. (Sed) 


The available data, obtained for various representative 
values for the filter coefficients a and b, indicates that 
the experimental and theoretical results for the amplitude 
of the limit cycles are verified. 
The experimental results for magnitude truncation are summarized 


in the following table: 


A. Range of . Range of Median of |d(n)| 
ie [a (n) | fon 1lkdas ferent 


M.ax 


max 
input frequencies 
10 OOOO es ON O02 Soo QO. CO olla 3 a3 


i, 000 OOOO 7 amie Oe. 2 5 Sh Soe Meee be 9 So 


The experimentally obtained amplitudes of the limit cycles 
are well within the computed amplitude bounds, eb eia chine 
Memetcomputed from (3.53)) and 60 (computed from 3.55)). 

The inspection of the data representing the discrete 
Pourier spectrum of the difference signal d(n) presents 
MecOnLusing picture. One or many spectral iines may re- 
present a limit cycle without any apparent pattern concern- 
ing the appearance and number of recognizable spectral com- 
ponents. Most, but not all of the frequency components in 


the spectrum, appear to be within a band defined by 


Fh 


fy 
Mt 


rhL oh 
c 


< 


(5.168) 
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where 


if = resonant frequency o£ the digi tadenie ioe 


fe = frequency component in the spectrum re- 
Presenting aline 


fe = lowest limit cycle frequency from the 
zero-input case. 


Berthermore, if the frequency of the input signal, fs and 
the sampling frequency, Eas are related by an integer I, 


meh that 


= = io : (5.249) 


fpen a limit cycle containing only one strong spectral com- 
ponent can be expected most of the time (but not always). 

mn, harmonics af either the input or the dominant 
component of the limit cycle can sometimes be observed. 
Meenas to be left for further research ee develop a better 
understanding of the frequency of the limit cycles generatec 
my Grther truncation or roundoff quantization in the pre- 
Meeieemor a forcing function to the digital filter. Despite 
the lack of understanding of the frequency of the limit 
cycles in the forced response, a new result about the ampli- 
tude of the limit cycles has been formulated in this section. 
If limit cycles are considered unwanted noise, then their 
Beeemecude can be reduced below a specified threshold value 
by relating the derived amplitude bounds to the quanti- 
zation step-size. In Behee wOrdS, USING a “worst-case: cde; 


Sign, the necessary number of significant digits cae “of &c 


oS 


Specified so that the limit cycle response is effectively 
suppressed. 

Before this pare anaion can be stated more formally, 
however, it is necessary to extend i:he results for the two 
Bete filter of Fig. 3.4 to the general case of digital 
filters with both poles and zeros in the transfer function. 
D. ted INFLUENCE OF ZEROS IN THE TRANSFER FUNCTION ON 

fai GIMIT CYCLES 

So far, the natural and the forced response has been 
studied for the two-pole digital filter as depicted in Fig. 
3.4. This restriction arises naturally because the limit 
cycle oscillations-of the quantized digital filter are 


defined completely by a knowledge of the poles or eigen- 


wen t art 
Mmeeees of the F 


However, all practical digital fil- 
meiceem 1 Zations contain zeros in their transfer function. 


mie zeros co not change the nature of the limit cycle. How- 


(0 


ever, they introduce additional gain, which may change the 
Mmeaghitude of the limit cycles. 

fie this section, the influence of the zeros on ore 
limit cycles of a second-order dicta tttlter sectiones 
considered. The treatment is restricted to the six most 
mmiportant and most often used digital filter configurations 


[2]. They have been derived in Chapter II and are re- 
Sa a a 
presented by the S-matrices Ss. ; 2s a flcie eremar er S 5 : 
i a 2 2 5 3 
mitst, consider the configuration 23 , which is depicted 
| 1 
in Fig. 2.4. Define the output of the leftmost summing 


ao 


Mode as y(n). Then, with quantization after multiv 


oa 


184 


operations included 
y(n; = -[a ee ee =i ele ee ay) (S20) 


Equation (5.20) is identical to the difference equation con- 
Sidered in che preceding section. It describes the limit 
cycle oscillations completely. 


The output of the digital filter x(n) is obtained as 


min) = [¢ ae ac eee (52a) 


meetene bound on limit ee defined by (5.20) is designated 


by A, and roundoff quantization is assumed then the bound 


i 
A, Saetne limit cycles in the filter output xn) 1s ,evaliua— 
ecw ttom (5.21). Designate X 9. (n) as the limit cycle jou 
the resnonse x(n) and Vy.) as the lamit cycie Of@tae 
response y(n). The limit cycle x X 9 o 7) has the biggest 


Possible amplitude, if Yog (n n) o ao 1) = Yo, (n-2). From 


(21) one cbhtains 
Be tt = ¢C Yo, (n-l) +).075 pmo (n= 1) 


+e yy, (n-2) + 0.5 + §(n-2), (5222-5 


and 


Ix). (n) | < Jote| ly, (mn) |+ eo. (5.22b) 


mas Can be rewritten as 


GS lc+e | A, + Eide (S2 Ze) 


An identical result is obtained for the configuratio: $._ 


(see Fig. 2.4), because §S and S aqitfer only by 
il aD 


Le 





Meeetcne filter coefficient d, which does not enter into the 


Meeolt (5.22c). As can be seen from Fig. 2.4, d = 9 for 
S ana ad = 1 for So 
1 2 
The configuration Ss. 1s depicted in Fig. 2.6. Following 


3 
the same steps as for the preceding derivation, it is found 


that 


x(n} = y(n) + [(ate) y(n-1)], + [(bte) y(n-2)1Q. 

(ae 3) 

ff a limit cycle occurs and its amplitude is bounded by Ayr 
mae largest possible contribution of this limit cycle in 


the filter output is designated A, end 1s bounded by 


— 


et eatcjes (bre))) Aiea 120: (Soin) 
: as ae al et Ja at 
eee o three tyyanspose contigdrations S| , GS, and S 5 
3 ir eal aa ine 
are considered. The configuration Ss 1s depicted in Fig. 
ek 


Meo. The output of the digital filter is described by the 


difference equation 


in) = -fa (0-1), - [b x (n=2) 1 + 
ieee) + fe eee en (5525) 


Combining the two input terms into one term, designated 


Me (n), such that 


: s Pi Bes 
eat) [c u(n 1)1, + fe u(n “aN ( ) 


™e25) Can be rewritten as 


~ ~~ 


(re = — | amemen—1)] “= “lb=xin-2) 7. + uu’ (nm) (acl 
Gg G 
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Bauvation (5.27) is identical in form to (5.1), which was 
investigatec. in the preceding sections. The amplitude bound 
from Chapter IIT ene directly toma iirc) c tem aiaon 
meee). An inspection of Fig. 2.5 for the configuration 

s* am@eerag, 2.7 Lor configuration s* indicates that the 
sion stated above is also aes ae £Oe sLnose con 


figurations if the input terms are properly redefined. Re- 


define x, (n) CoOmuCont marathon = (S@e. Fig. 97.5 ds 


2 
Gy) = x, (n). (5.28) 
Mien it is found from Fig. 2.5 that 
y(n) = -[a y(n-L) 1, - {b y(n-2) 1, + [oe utes 
+ fe u(n-2)]}. (54.29)) 


The output of the filter is given by 


= (ae = cn Sat) (ac) 


ff the limit cycle amplitude is bcunded by Aas then the 


Me@imioucion A. of this limit cycle in the filter output is 


z 
given by 


De = An. (node 


mipebarly, for configuration Ss. (see Fig. 2.7) one obtains 
3 


“A 


(Te) ~Lax(n-1) 1, - [b x (n=2) 1, + u(n) + 
jee ere) u(n-1)], + [ (bte) u(n-2)]1,. (5262) 


meet aon (5.32) can be rewritten into (5.27) 1£ the three 


f 


input terms are combined into one term u'(n), sucn 
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= cece ae 1 Gores) ee 
(os) 
As has been stated ae the amplitude bounds from Chap- 
Meaeerit apply directly to a limit cycie from (5.32). 

At this point one might well ask what effect the quanti- 
Metron of the input sequences in (5.26) and (5.33) has on 
mae performance of the digital filter. Clearly, it has no 
influence on the generation of limit cycles. On the other 
mem@emeeche quantization of the products in (5.26) and (5.33) 
produces errors, which are best described by a statistical 
mm@elysis. This has been done successfully by Jackson [2] 
and others. A comparison On (5222) - Hon 24) cic ee) 
Pefows that the size of the limit cycle contribution in the 
Seeeteror the filter can be minimized by a proper cheice 
meeconriguration. 

For example if a Butterworth or Chebyshev low-pass 
iter is considered, whose zeros occur at z = -l, then 


mor Configurations oe and S° the coefficients 
S 3 


atc = 2.0, (5.34a} 


bte = 1.0. (334) 


Mrom (5.24) and (5.31) it is seen that Se should be pre- 
3 
ferred over Ss. . With similar arguments it can be deduced 
5 


i Bor this to be true; it iS assumed that the bilinear 


leans tOrmataonm las been used to obtain H(z) fisgs 14) 
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ew fOr zeros in the left half of the unite ecireteavi nero 


mepiane the configurations et ; gt ; eu are general) psec 
ie ee : 
Berable compared with configurations S_,S_,S5S_. 
| ay a5 a. 


If a Butterworth or Chebyshev high-pass Peer Meweon= 
sidered whose zeros occur at z= 1, then an identical treat- 
Ment as above leads to the conclusion that configuration 
S should he preferred over 8 ; FOY Zeros in Ghemeront 


B 3 
half of the unit circle in the z-plane the configurations 


oe ho. are generally preferable compared with con- 
ay a? > 
figurations > ? S. ’ st : 

ai 2 s 


In summary, the results of this important section allows 
meme tO State an amplitude bound ‘for that pert Gry ene vouce ue 
Baa general second-order digital filter, which is contributed 


Sento: els 
Wy ws 


e 
7 vw 
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rcle oscillations dqenerated in that fiiter. 
Depending on the numerical values of the zeros in the trans- 
mer f£unction some filter configurations are preferable over 


others if the magnitude of the generally unwanted limit 


cycles is to be minimized. 


fee HLGHER ORDER DIGITAL FILTERS 

It has been shown in Chapter II that higher order digi- 
Mmeeierters are generally realized by either a cascade or & 
parallel form which is composed of second-order subsections. 
These two forms are now investigated with respect to their 


minmat cycle behaviour. 


if 2 ew . 
FOG Enis to be true, Lt is assumed that thie ai ear 


PLenGteeCrMation tas been wseda tO Obtarr if (zZ ) =: ge ee 
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Pirst, consider the parallel form.) Penis ee eee 
ms seen that all second-order subsections share a common 
input and the ee summed over all sections. ss teuc. 
each section generates its own limit: cycle and all these 
limit cycles are then summed together to form part of the 
output. If the bound on the amplitude of the limit cycle 
generated in section G. is given by As then a bound A of 
the sum of all the limit cycles in the overall output is 


given by 


M 
Bec) OCA. (35)) 


Mr situation 1s more difficult for a cascade form. From 
mtg. 2.3, it is seen that the output of each section feeds 
Meeuet into the next section. Therefore, a iLLime. oye ve 
generated in section G. 1s input to section Gray and gets 
fritered there and in all subsequent sections. If it is 
assumed that the limit cycle oscillation. generated in 


miter section G. 1S practically sinusoidal, then thas) i.e 


cycle can be approximated by 


x, (n) = A), sin n wT. (5236) 


The magnitude A,. of that portion of the overall output, 


1 
waieh is due to the limit cycle oscillation from section 
G. 1s then given by 
M ju. , 
= | . 37. 
AA, = Ay. talk | Hy, (e ) | (S679 


mer evaluate (5.37) it is necessadr to know the frea ey 


Loe 





iE. 
it 


E 
S 


accuracy. 


for the limit cycle under consideration with ssuntvervent 


Accurate information about the frequency is only avail- 
meer or Zero-input limit cycles. For limit cycles, which 
are generated as part of the forced response, it has not 
been pessibie to estimate the frequency with reasonable 
Meeuracy. This has been pointed out in the preceding sec- 
[Pons Band C. For the cascade form of digital filters, 
fire Magnitude of that portion of the overall output, which 
is due to lamit cycle oscillations from the individual fil- 
mer subsections can in general not ke evaluated with 
acceptable accuracy. 

[eeeyer, if the passbands of the individual filter sec-— 
tions are well separated, then it is safe to assume that 
only the limit cycles generated in the last section of a 
merecage are of significance. This observation suggests that 
filter sections with equal or nearly equal passbands should 
not be put in cascade with each other, because the nearly 
miiicotdal limit cycles of the first stage will most likely 


Zmmemranced in the next stage. 


FF. SUMMARY 

The results of the preceding chapters are generalized 
in this chapter, such that they are applicable as design 
mumeaes £LOr practical digital filters. First, the step 
response and then the forced response for general, but de- 


= 2k 


SBerministic inputs was evaluated for the two-pole dm@itad 


eo 


filter. It was shown that the forced responses of the 
Sigentized ard the linear digital filter differ by a signal, 
Bach is described by a limit cycle oscillation. The ampli- 
tude of this limit cycle is estimated by the same bounds 
which have been developed in Chapter III for the zero-input 
case. 

The results for the two-pole filter are then extended 
bo the case of a general second-order digital filter, whose 
linear equivalent has both zeros and poles in the transfer 
Mmem@etion. It was shown that the part of the filter output 
which is due to limit cycles can be minimized by a proper 
Bmerce Of digital filter configurations. If the zeros of 


the filter are in the right half of the z-plane, the con- 


Meogretions ©. o, § 9, are te he preferred over tne 
a T T 
Meicpose conficurations S_ , S_ , S. . TI£ the zeros of 
ay ao a. 
Meee tiiter are in the left half of the z-plane, configura- 
7 1 T ee ae z eae 
mens So , S., s age CLOebe Oren erteGd OVer Con mn ar 
a a a 
i 2 Ee 
mo, , (S.C 
1 2 3 


Mmeaily, limit cycles in higher order filters were con- 
Sidered. The parallel foun is easy to analyze, because 
the limit cycles generated in- the individual filter sub- 
sections are added in the output. The cascade form iS more 
difficult to analyze, because each limit cycle is filtered 
in the following filter subsections. If the passbands of 
the cascaded filter subsections are well separated only the 
limit cycles generated in the last stage are of significance. 


: 
(es, ~ 


There remains an important area for whicn further searcn 


oe 


is necessary. It has been impossible to predict the fre- 
Saency of the limit cycles which are present in the forced 
resvonse of the digital filter. This information is needed 
to evaluate the magnitude of the limit cycle output of a 


Gigital filter realized by the cascade form. 


oo 


VI. CONCLUSIONS AND SUGGESTIONS FOR FURTHER RESEARCH 


The purpose of this research has been to contribute to 
the analytic solution of the phenomenon called limit cvcle 
oscillations in recursive digital filters with finite pre- 
cision arithmetic. Despite the fact that these limit cycles 
can become large as a function of the quantization step- 
size, they can be made arbitrarily small by increasing the 
number of significant digits of the data. This increase 
results in an increased dynamic range with a corresponding 
improvement of the signal-to-noise ratio in the filter out- 
put, where the limit cycle signal is the noise. 

The existence of limit cycles snould be viewed as an 
important consideration to be included in the design and 
implementation phases for digital filters. Building a re- 
cursive digital filter involves several steps, as follows: 

a) The approximation problem. 

b) Specification of the number of significant digits for 
the filter coefficient (this is not necessarily equi- 
valent to step (e) which follows). 

eyeeeoe lection of a filter configuration. 

ad) Choice of the arithmetic mode which is most likely 
to be fixed-point arithmetic if. economical special 


purpose hardware is designed. 


e) Specification of the number of significant digits 
ieee 1Cla tal. 


These steps are interdependent. Since no optimal pro- 
cedures have been devised which encompass several of the 


above steps and would lead to a unique solution, it is 
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necessary to go througn design steps (a) through (e}) several 
Mes until a satisfactory realization of a digital filter 
has been formulated. Design decisions, to be made at step(c,; 

and (e),are influenced by consideration of the possible, 
undesired limit cycles. 

Peman example, consider the worst-case design of a 
mereond-order digital module. For simplicity, the influence 
Meeene zeros in the transfer function on the magnitude of 
the limit cycles is negiected (in practice, the influence of 
the zeros will most likely result in a reduction of the 
Mmimtt cycles; see Chapter V). 


Assuming that intermediate limit cycles with frequencies 


fF 
oe) 7 oO a ; ae 
er such that 0 < a xr are a problem, the amplitude 
S S 
Meer 4.5) 1S Selicctcd as desicn guide The sianal-to- 


noise ratio in terms of the number of significant digits k 


mor the data can be written as 


S 


(2) Asignal _ Le (Sy 


20m Log 
eS, 


db =O melaey cs (6.1) 
Ago 


For the evaluation of (6.1) it is assumed that the signal 


is kept at its maximum level of Lo WNT es sand the amp lies 


- 


tude of the limit cycle is bounded by = from (4.4). The 


mamoer of decimal digits k, needed for a specified signal]- 
to-noise ratio, can be related to the number of binary 
meres K for a binary realization through the relation 


De = io or | (6.2) 


k kk ; aC 
Sees a a (O25) 
“ ogee Or, 30102 ae . 








some numerical examples for the evaluation of (6.1) and 


feo) are stated in the following table: 


(S/N) 5) Kf{bit] for K [paar 
coefficient b=0.9 coefficient b=-0.99 





30 Ge Ve 
60 13589 eZ 
20 Ones Dyce 
| 2 0 Zoe 2 hee 


From (6.1) and (6.3) it can be deduced Chatva practme. a, 
Be@eaking, tne existence of limit cycles in digital filters 
1s not a ieee facCeor On Ehelr- reat zavion, but only an 
Lmportant consideration to be included in the implementation 
M@eceeof these filwens. 

The major contributions of this reasearch are now sum- 
marized. In Chapter II, the linear model for second- 
Seager digital filters was described and 24 canonical cir- 
Pmetmcontigurations, under the assumption of k-digit accuracy, 
were shown to exist. A general formula to predict changes 
in pole positions due Poeneeee from the nominal values ot 
coefficients because of finite representation of numbers 
was derived. Chapter III is the most important chapter 
Pees dissertation. Many new results about zero-input 
limit cycle oscillations due to roundoff were presented. 
It was shown that the limit cycles Campbe expressed by ya 
matrix equation which was then used to derive an absolute 


mend for the amplitude of the limit cycles. Other 
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amplitude bounds were derived employing Lyapunov functions 

ana the effective value linear model devised by Jackson 

[27}. However, it was also demonstrated, that the latter 

bound can be exceeded by several quantization units and 

is, therefoxe, only a convenient to apply rule-of-thumb. 

The limit cvcles were portrayed in a specially defined 
Successive value phase-plane plot. Some symmetry properties 

of the state trajectories were showr to exist. An approxi- 

mate expression for the frequency of the limit cycles was 
agerived. Finally, it was shown that: magnitude truncation quantization 


Panett sustain zero-input limit cycles other than with 
ii 
2 « 


IIT were verified in Chapter IV with experimental data ob- 


frequencies £A/f. = Q, The anaiytic results of Chapter 
Meer com thee comeuter vrograms. The analvsis program 
for zero-input limit cycles enumerates all possible limit 
cycles for specified filter coefficients and tabulates and 
plots them on the successive vaiue phase:-plane. The 

second procram evaluates the different amplitude bounds to 
facilitate a comparison between the bounds. The third pro- 
gram simulates a Aigitvall osemietes which can be used for 
Gigital function generation. - The data shows that any dc- 
gree Cf approximation of an ideal sinusoid can be achieved 
which is contrary to a formula derived by Rader and Gold 
[12]. The results of the preceding chapters were generali- 
zed mamchapter V. The Lorced respense for general, but 
deterministic inputs was evaluated for the two-pole filter. 


The results for the two-pole filter were then extendas to 


ey 





to the case of a general second-order digital fitter sare 
Ileth zeros and poles in the transfer function. It was 
Shown that the magnitude of the limit cycles can be mini- 
mzea by a proper choice of the digital filter configuration. 
melt cycles in higher order digital filters, Sidene reali- 
zed by the parallel or the cascade form, were considered. 
Finally, it was concluded, that magnitude truncation quantization 
offers no acivantages over roundoff quantization because the 
errors due to magnitude truncation can be twice as large as those due 
moeroundoff. 

There remain several unanswered problems which have 
arisen as a result of this research and should be noted for 
further investigation. Among them are the following: 

me A copclocical investigation ot canonical seconuGa- 
Order digital filters to determine a relation between the 
minimum number of delays, multipliers and adders and the 
Order of the poke ceeenee Cquatvoneot sa seanonleals Clon ea 
Liter. 

b) A general definition and derivation of all possible 
canonical forms for the second-order Cagita. EilLeex, were: 
the restriction of k-digit accuracy (see Egs. (2.13a-d)). 

ee An investigation of the roundoff noise properties 
@ieene twelve newly derived second-order digital filter 


Ehroeugn Sy and their transposes (see 
iL 6 


configurations S) 
Seetion Tf.C). 
d) An exact analytical expression for the frequency of 


limit cycles generated in the presence of a driving “mmctiagn. 


oS 





e) A general relationship between the sampling period 
T and the number of significant digits required to revre- 
sent data, i1.e., a relationship between the precision of the 
Gata if it 1s to approximate a continuous signal in some 
specified sense. 

ie A spectral analysis of the limit cycles of a digital 
oscillator, i.e., tne frequency spectrum of the limit cycle 
mca measure of its deviation from 4 Pure sinusoid. 

g) An optimum design procedure which starts with the 
filter specifications and results in an optimum implementa-- 
fee, complete with coefficient truncation and selection 


ee ae best" configuration. 


oS 


APPENDIX A 
AN UPPER BOUND ON THE DYNAMIC RESPONSE OF NONAUTONOMOUS 


(FORCED) DISCRETE SYSTEMS USING LYAPUNOV'S DIRECT METHOD 


A. INTRODUCT'ION 
The region of boundedness of the dynamic response of the 


discrete system with constant coefficient matrices A and B 
man 1) = seen) + Bam) = Cs) 


is studied in this appendix. A bound on the dynamic re- 
sponse of the system (A.1) utilizing Lyapunov's direct 
method is presented. The method of proof is based on a 
meaper by Jonnson [21] in which a bound on the quantization 
error in sampled-data control systems is derived. Ccrrect- 
ing and clarifying comments by Lack [22] and Johnson [22 
are used in the proof to improve the bound. 

The importance of the theorem which is stated in the 
next section rests on the fact that an absolute bound on 
the magnitude of the dynamic response is obtained without 
fetetence to the detailed nature of the input to the system 
ince must only be bounded. 

SeeeelesOREM: A BOUND ON THE DYNAMIC RESPONSE OF FORCED 
DESC hE Rea@oy > DEMS 

Tt is well known [37] that the linear discrete system 
(A.1) is bounded-input bounded-output (BI-BO) stable, if the 
homogeneous system 


x (atl) = Ax (n) (3.2) 
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ms asymptotically stable in the large (ASIL). Im this 

case (A.2) rossesses a Lyapunov function V = x Ox, where 
Quis areal, symmetric and positive definite matrix and 
can be found for any real, Symmetric, positive definite 


matrix C from the equation 
i 


If the input to the system (A.1) is bounded by a constant 


as 


Juin) | < k (A.4) 


Te 

Pmenethe following theorem which estimates the region of 

boundedness of the dynamic response can be stated. 

ae Casem Powrtnowcysrem S<O1+l)) = Ax Oy) + BO Gy) eet ote 
homogeneous system is ASTL and has a Lyapunov 
Function V = xox with AV= -x'cx and [u (n) | < ky 
Coe cdi ee, weelen “Chey > Gentes Ss eaole wane 


the states are certain to enter a region defined 








by 
I> < Kor where 
io | 
r d max (OQ) : 1 Le ToBI 
se) eon Onn inne: 
oes ae ae ee 
ae ils 
[atonll + ee aCe (A.5) 
Cc) min iC) 
Here 
XA min(C) = min. eigenvalue of the matrix C, 
Pern /ta (OO) = min./max. e1genvalu of tht Tak 
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a“ os || = norm of the matrix product a‘os, 


>| = norm of the state vector x. 


fee PROOF OF THE THEOREM: 

fie system (A.1) is stable as mentioned in secticn fe 
and proven in a paper by Kalman and 3ertram [37]. 

Before the rest of the theorem can be proven it is neces- 
Sary to state a lemma, which is given by LaSalle and 
Lefschetz [38] for continuous time systems and is here re- 
written and proven for discrete-time systems. 


Lemma: Consider the discrete system 


x(n+l) = Ax(n) + Bu(n), (A.6) 
with V being the Lyapunov function for (A.6). De- 
fine sects of points in n-snace, where n is the 


dimension of the system, as 


eae 
Mo = complement of M = {x: [| x|| > r,3 
es [|x|] < eon 
Me = complement of M + M = {x: xi > Yo}. (A.7) 
These regions are depicted in Fig. A.l. If AV < 0 


—= 


Cc ; 
foueal. © 2a Mo cand it Vix(n5), no] > Vix(n,), nj] 


EOrra t. Ny 2a) 


239) M-, Enenmecach states oOt (A,6) whien at sscome seme 


peace x(n, ) in M and all x (no) 


Nor such that ny > ny > 0, is in M, can never 


thereafter leave ne 


a 


To prove the lemma let x(n) be a *stace Of (Zo eh) 
at a O is in M. Assume that at some later time N > Noe 
ae) Cc 
mM) 2S in Mee 


LF this is the case, then there exists an where 


7. f 


ny <n, < . Such Enaey< (0), 25 sin MS for all n such that 


nM, <n < N and that n, Lbs the Smallest numb eiasy eee nage 
MeOperty . 

This implies that x(n, ) 1s in M and therefore by hypo- 
thesis Vix(n,), n, J eve rN | But this increase in V 
Mmeontrary to the -hypothesis that AV < 0 for ean in 
M°. Therefore if the state x(n.) is in M at some time Ny 
LE Can never Uneres 

Mmeeis inportant to recognize that if the state of this 
system is in M at a time Noe it is not necessarily true 
that the state of the system remains in M for all sub- 


Sequent times. The lemma only asserts that the state remains 


inside the region M- 


The previous lemma will now be employed to derive the 
bound on the dynamic response of the system (A.1). Use 
V - x Ox asvawbyaeounoy LUNCE1om For tChe=fouced System. 
Then the change in V is computed from the forward difference 


as 
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AV 


i 


V [xo | xin i 
= -xt cx + 2x atosu =e u'B oBu. (A.8) 


Since ju| < k, and, for |x|] sufficieatly large, the sign of 


db 
AV will be Gominated by the term -xtox, which is negative 
definite. Ft follows, that there exists a region of points 
Pea Space , Mo, within which AV < 0. Here, M’ is the 
complement of M, as defined before by (A.7). 

To estimate ry it is recognized that BOB 1S a positive 


scalar because Q is chosen according to (A.3) as positive 


definite. To assure that AV < 0, u(n) is replaced by its 


— 


bound ky and 2a OB 1s assumed to be positive. Then AV < 0 
eg 
u eh ant a : v 
BoQB ky + [2x A°QBk,| < x™Cx. (A.S) 
For a real, symmetric, positive definite matrix, it 1s 
known aaa 
cane He 
ee x Cx ) = fom KC) I|><{I : (A.10) 
Suoetrtuting (A.10) into (A.9) one gets 
laxTaTopk, | <:2..(C) [xf]? - BZ opk? (A.11) 
et ato line 
which implies the inequality (A.9). Introducing norms of 


feieices-, (A.11) is rewritten as 


J See vmeor e-ane.e beliman [39!5)p. L1IO-113- 


Z a Bs , 
See, for example, Kalman and Bertram [37), p. - 
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HAToB! k, < hein (C) [lxfi? - BTOBK‘. (A.12) 
If the eaquality-sign in (A.12) is used a bound r, on the 
region M in which AV < 0, is defined by 

2 


mee (C) ry - 2k, aT oa] r, ~ B'OBK* 


li 
oO 


(Avale3) 


solving the quadratic equation (A.13) for the one positive 


root the bound on the region M is found to be 


(Ee) 





In (A.14} only the-positive sign of the root can be used, 
because ry 70, dowevyer, as Was pointed Cut earl Tea ry 


Peammoen NC LNe agsolu 


cc bewnads fer the dynamic response 

of system (A.6) because it is not assured that the state 
bemeains in M, once it got there. It, therefore, remains to 
evaluate a correction factor to properly estimate the 
boundary of the region Mies Which taewstatcuwlli neyvere eq cy 
once it has been in the region M. | 


Since Q is real, symmetric and positive definite it 


follows that there exists 


max V = max [xt ox] a rf eee O)) (he a 
xeM Ixj[=r, 
ioe, 15 defined as xi] = r,, where 
min V = max V, then (ASiS) 
seme xEM 
im 


ZS 





Z 2 


Lo Dees (‘CO — ry Oe Oye) 


meom {(A.17) it follows that the correction factor to properly 


estimate the boundary of the region M. is given by 





t5 = (Asks.) 
Now the conditions of the lemma are satisfied, because 
AV < 0 mer all x in Mo and furthermore 
ee ese (A.19) 
ee i Mass : : 


xeM 


and each state, which at some time was in M can never there- 


meeeeetcave M_ . Thus r, is the desired bound such that 


as 
—_ 
ee ‘ 


— 


P Amax (2) | faTopl 
s Af max "| _VA GBI 
lll a St \ La eG: ; Meme) a 
min 


(A.20) 
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eos, l: Separation of State Space into Regions M, Me MY. 
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APPENDIX B 
EXPERIMENTAL DATA COMPILED FROM COMPUTER SIMULATIONS 


fee ANALYSIS, PROGRAM FOR 4ZERO-INPUT LIMIT CYCLES 

The data compiled in this section applies to the digital 
filter discussed in Section IV.B. For given values for the 
ferter coefricients a and b, all possible limit cycles with- 
in the region of search, are enumeréted in the tables B.1 to 
B.16 ana laseiled by an identification number. The fre- 
quency F = £/f. and the values of the limit Cyete peints are 
megeec. Furthermore, for each set of numbers for a and b, 
Ene values for the approximate frequency (3.59) from the 


linear model ane the amplitude bound (3.46) and (3.53) are 


‘printed. 
Mee phase-piane pivots WOT Most salcctions of a and bh are 
: “A 
Gisplayed in Figs. B.1 to B.14. The x-axis represents x(n) 


and its values are labelled in the top line. The y-axis 
represents eae and its values are labelled in the left 
femme A state trajectory is identified by those state- 
points which are labelled with the same number. This num- 
noes che same as. the Limit cycle identification number 
eeyom in the corresponding table. For example, consider 
femee cycle +2 from table B.1l. The Gorresoondind psveucmenas 
Meetory is displayed in Fig. B.1 and is constituted by the 
imemistate points labelled "2", such as (1,-3), (5,1), (8,5), 
eye, (8,9), (6,8), Foe me Oe 


eo (oo ye (-G,-C), (—3,—6) . 
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maple B.l: 
meMrT CYCLE OSCILLATIONS GF DIGITAW FIL ER Vea ee 


A=-1. 7000G6CG0, B= 0.93 7G0CCO0U;, APPROXIMATE FREQUENCY F= G.079402 
Mee sAMPLi;:UDe BOUNDS ARE A 1= 7.93754 2=) 42.7599 


eet CYCLE + TWiT FREQUENCY f= 21452557547 
aoe Oo OO 3 1 2 8 2 8 6 Do ees 
Mi CYCIE # 2WTVn FREQUENCY Fa pew 3 555 5 ee 
5 ZO 2 eee Oe oe 2 2 e) if f 
eet CYCLE # SK 1H PRE QUENCY F258. 553333650, 
—o —-4& -il 2 i > S é. ZS oa oes 
Meee) CYCLE # 4W TVA OPREQUENCY ls) 622354550 7 es 
moe >D OCS Q 2 5 6 5 3 © eee 
Mai) CYCLE # SWillH PREQUEHCY, = “8753327320 —(7 
—o -4 %~2 ii 4 6 6 4, oo \=2 Stee 
Meee CYCLE # GEWil dm FREQUENGY P=) O33 3545 40= 7 
ate So OC) iy 3 4 5 at ee a at 
Mey CYCLE #. 7WITH FREQUENCY F= 1.000QC0E—-01 IS 
=o 2 Qj ee me 


ACO Ea. 


i 

[ 1 

2 Z me eZ 
{ 

a 


= 

3 

Meee CYCLE 4 BWITtH FREQUENCY F:= 
me |6|C lL Q 1 Z a Z G 


cae as — = : ewe eww is ee . w aes Meant 
eee CYCLE *F Bult FREGUCNGY C= Pee ree 


Meee) CYCLE LOWITH FREQUENCY F= thecveuemG: tay ay 
Meee CYCLE # LIWITH FREQUENCY F= S.0NCO0KE+OO I 


brat 

es 
{ 

=i 


“st 


= 
(~) vv) 
a 
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maple B.2: 
mrik?t CYCLE QSCILVAT IONS OF DIGI aa aaieee 


Dic 
TH 


LIMIT 
1 
6 
LIMIT 
—6 
LIMIT 
-6 
LIMIT 
—5 
LIMIT 
-5 
LIMIT 
-4 
LIMIT 
—4 
LIMIT 
-3 


ey i 1 
ic. 


Polit T 
tigia) T 
ey 


E 
-3 -6 


4f 
~~ 


CYCLE 
6 3 
evcuce # 

-4 °° 9 


CYCLE # 
=5  =2 
CYCLE # 
-3° 9 


ete, 


4 


CYCLE # 
a2 1 


— 3 
CrCuLe + 
-—2 QD 
Weer 
-] ") 
CYCLE + 
GYCLE @ 
CYCLE “# 


CY CRE 
= 


TYPE A 
> B= 06937009995, APPROXIMATE FREQUENCY F= 0.198924 
BOUNDS ARE A l= 7.937;4 2= 2228 
IWIito PREQUENCGY —-=dovleroe 0 ee 
ane 1 5 7 6 2-3 eo) Oe en 2 
Soe 7 ee 3 7 g 5 
Pia TH OPREQUENCY (F227 sine cme 
$ 6 : 2 <=-2 -5 
ayi17 HH EREQUENCY fF. tet bl leo 
2 5 6 “4 O- =o 
41TH FREQUENCY 9b] Ue dCCeGl a lis 
5 5 20 5G: a eee 
SWITH FREQUENCY Fe 1.e1LL11LIE- ies 
2 a 4 i =n 
6WITH FREQUENCY F= 1-12111116-€1 IS 
4 a 4 =ge | 6a 
TJWITH FREQUENCY F= 1.000000E-01 IS 
l 3 os) 1 -} =-3 
Swit EREQUENCY F=" PeeOctore- cme 
> 2 2 (¢ -2 -3 
SWITH FREQUENCY FH 1.00065GE-4i 15 
] Zz Z i ) af ie 
1OWITH FREQUENCY F= O.N0009CE+G0 IS -i 
LLWITH FREQUENCY F= 0.G0GOO00FE+HON IS ¢ 
12WITH FREQUENCY F= Of£0CC00GE+00 IS 1 
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emit CYCLES ARRANGED ao 
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faole B.3: 
Mee) CYCLE OSCILLATIONS OF BIGITAL FULTER, 1YP@E ws 


A=- » B=_0<.9370000CCS APPROAIMAIE FREQUEIICY ——eG ei 32a7. 
te BOUNDS ARE A l= 7%.9377A 2= 1.5790 


Mae CYCLE # LWITH FREQUENGY: F= 1la3o363CE—0 its 
a 5 t 4 et ee 4 if 5 GP eas 


= -7 -4 2 
7 7 2 -4 -7 =5 
LIMIT CYCLE #  2WITH FREQUENCY F= 1.333333£€-C1 IS 
-6 -2 3 6 5 1 4 “-6 -4 “1 °°5 6° 3 =-2 6 
LIMIT CYCLE #  3WITH FREQUENCY F= 1.333333E-01 IS 
-6 -3 2 6 6 2 -3 -6 -5 =-1 4 6 4 -1 =5 


mere) CYCLE # 4WITH FREQUENCY F= 1.25000CE-0Q1 IS 
mo 2 Ze 5 g Ae =e Ee 


meat CYCLE: #@ SBHITH FREQUENGY F= 2.3630365-0 00K: 
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* LIMIT. CYCLES IN DIGITAL FIlLiets. tee ee re 
REAL*8 ITAG(12)/'AMPLITUDE BOUND CASSUNE PERIOD OT) 
* LIT CYCLES IN DIGITAL FILTESS. S.p-aH Soe 
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